-- Logs begin at Wed 2021-07-28 02:58:32 UTC, end at Wed 2021-07-28 04:24:22 UTC. -- Jul 28 03:24:28.415870 dv-cinder-733062-21-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 03:24:28.423078 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 03:24:28.425138 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 28 03:24:28 2021] *** Jul 28 03:24:28.425138 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:24:28.425138 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:24:28.425138 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: nodename: dv-cinder-733062-21-iscsi Jul 28 03:24:28.425138 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: machine: x86_64 Jul 28 03:24:28.425138 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: clock source: unix Jul 28 03:24:28.425138 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: pcre jit disabled Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: detected number of CPU cores: 4 Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: current working directory: / Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: your processes number limit is 47680 Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: your memory page size is 4096 bytes Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: detected max file descriptor number: 2048 Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: lock engine: pthread robust mutexes Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: thunder lock: enabled Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 03:24:28.425542 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 28 03:24:28.471188 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: Python main interpreter initialized at 0x564ef7fce9c0 Jul 28 03:24:28.471188 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: python threads support enabled Jul 28 03:24:28.471188 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: your server socket listen backlog is limited to 100 connections Jul 28 03:24:28.471188 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:24:28.471552 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:24:28.471659 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: *** Operational MODE: preforking *** Jul 28 03:24:28.471963 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:24:28.471963 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: spawned uWSGI master process (pid: 72563) Jul 28 03:24:28.472160 dv-cinder-733062-21-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 28 03:24:28.473501 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: spawned uWSGI worker 1 (pid: 72578, cores: 1) Jul 28 03:24:28.473501 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: spawned uWSGI worker 2 (pid: 72579, cores: 1) Jul 28 03:24:28.473501 dv-cinder-733062-21-iscsi devstack@keystone.service[72563]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:24:33.565307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:24:33.565307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: from cryptography.utils import int_from_bytes Jul 28 03:24:33.566065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:24:33.566065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: from cryptography.utils import int_from_bytes Jul 28 03:24:33.566481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:24:33.566481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: from cryptography.utils import int_from_bytes Jul 28 03:24:33.566587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:24:33.566587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: from cryptography.utils import int_from_bytes Jul 28 03:24:33.615974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:24:33.616142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:24:33.616214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:24:33.616290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:24:33.616360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] command line args: [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:24:33.616420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] command line args: [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:24:33.616643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:24:33.616732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:24:33.616797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ================================================================================ {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:24:33.616861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ================================================================================ {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:24:33.617046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] admin_token = **** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.617758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] admin_token = **** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.617830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] config_dir = [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.617894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] config_dir = [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.618064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.618206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.618330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] config_source = [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.618445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] debug = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.618518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] config_source = [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.618582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.621102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] debug = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.621102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.621548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.621779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.621953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] insecure_debug = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.622153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] insecure_debug = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.622383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.622551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.622748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.622943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.623138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] list_limit = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.623335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] list_limit = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.623531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] log_config_append = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.623758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] log_config_append = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.623956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.624126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.624334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] log_dir = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.624529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] log_dir = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.624726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] log_file = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.624939 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] log_file = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.625133 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.625323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.625517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.625711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.625881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.626017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.626190 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.626327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.626494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.626640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.626775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.626909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.627040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.627200 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.627332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.627469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.627602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.627764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.627902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.628028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.628151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.628294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.628426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.628581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.628726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.628861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.629006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] notification_format = cadf {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.629142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] notification_format = cadf {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.629272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.629411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.629543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.629675 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.629809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] publish_errors = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.629933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] publish_errors = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.630073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.630205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.630337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.630466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.630598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.630827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.630967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.631220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.631387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.631522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.631522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] standard_threads = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.631798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] standard_threads = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.631927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] strict_password_check = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.632068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] strict_password_check = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.632198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.632329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.632459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] use_eventlog = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.632592 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] use_eventlog = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.632826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] use_journal = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.633013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] use_journal = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.633176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] use_json = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.633316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] use_json = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.633442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] use_stderr = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.633579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] use_stderr = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.633711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] use_syslog = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.633842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] use_syslog = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.633967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] watch_log_file = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.634107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] watch_log_file = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:33.634233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.634369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.634501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.634630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.634761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.634886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.635016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.635149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.635275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.635399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.635522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.635646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.635826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.636043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.636171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.636295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.636419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.636548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.636673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.636809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.636935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.637059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.637182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.637305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.637429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.637561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.637709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.637839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.637964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.638088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.638218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.638351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.638476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.638606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.638730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.638859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.638989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.639122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.639248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.639379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.639522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.639654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.639810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.639948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.640082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.640213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.640213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.640453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.640588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.640588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.640829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.640953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.641082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.641217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.641352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.641483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.641612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.641737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.641861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.641861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.642174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.642174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.642417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.642417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.642655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.642779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.642909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.643049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.643175 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.643299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.643422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.643544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.643679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.643846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.643973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.644097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.644227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.644358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.644494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.644624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.644765 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.644891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.645014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.645138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.645273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.645399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.645528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.645653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.645777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.645900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.646039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.646169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.646294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.646418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.647597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.647834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.648070 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.648233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.648925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.649114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.649340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.649504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.649759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.649955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.650120 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.650309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.650499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.650699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.650923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.651093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.651286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.651481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.651672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.651911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.652073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.652268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.652458 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.652648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.652836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.653005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.653176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.653317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.653480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.653607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.653773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.653917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.654057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.654184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.654317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.654475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.654606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.654733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.654858 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.enabled = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.654983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.enabled = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.655128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.655255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.655386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.655512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.655512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.655820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.655961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.656093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.656224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.656355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.656486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.656620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.656747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.656882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.657008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.657132 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.657257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.657390 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.657515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.657646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.657779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.657905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.658030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.658232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.658365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.658532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.658700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.658843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.658970 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.659103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.659238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.659376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.659508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.659634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.659819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.659961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.660089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.660214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.660338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.660463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.660593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.660736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.660863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] auth.external = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.660998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] auth.external = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.661131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] auth.mapped = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.661258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] auth.mapped = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.661382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.661508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.661508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.661756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.661881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] auth.password = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.662015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] auth.password = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.662141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] auth.token = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.662266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] auth.token = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.662408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.662535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.662660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] catalog.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.662785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] catalog.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.662910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.663036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.663172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.663298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.663423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.663548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.663673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.663821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.664558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.664705 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.664843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] credential.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.664969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] credential.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.665094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] credential.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.665226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] credential.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.665360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.665487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.665612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.665738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.665863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.665988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.666125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.666282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.666422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.666558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.666690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.666823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.666949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.667144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.667298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.667432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.667566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.667693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.667880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.668009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.668143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.668271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.668398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.668533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.668659 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.668785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.668919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.669051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.669185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] federation.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.669322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] federation.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.669455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.669581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.669715 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] federation.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.669842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] federation.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.669968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.670093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.670224 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.670365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.670500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.670628 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.670755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.670880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.671006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.671132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.671266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.671392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.671525 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.671652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.671800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.671928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.672075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.672203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.672329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.672455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.672580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.672706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.672839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.672967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.673093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.673219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.673345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.673478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.673606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.673742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.673886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.674087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.674240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.674446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.674577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.674703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.674703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.674950 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.675076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.675218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.675346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.675472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.675599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.675753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.675886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.676028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.676161 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.676296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.676423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.676548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.676675 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.676813 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.676941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.677067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.677194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.677319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.677511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.677655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.677784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.677910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.678037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.678170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.678296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.678430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.678557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.678689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.678689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.678928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.679060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.679199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.679339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.679499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.679781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.679781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.680114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.680114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.680371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.680498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.680624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.680624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.680862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.680862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.681109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.681236 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.681379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.681506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.681632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.681769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.681897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.682023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.682149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.password = **** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.682274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.password = **** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.682400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.682534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.682669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.682795 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.682921 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.683058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.683184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.683318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.683445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.683571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.683697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.683847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.683974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.684114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.684242 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.684367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.684493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.684618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.684744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.684888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.685015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.685142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.685268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.685393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.685518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.685652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.685778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.685904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.686030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.686156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.686281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.686415 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.686543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.686680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.686807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.686932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.687066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.687194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.687320 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.687445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.687570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.687702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.687863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.687992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.688123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.688250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.688385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.688512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.688646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.688773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.688900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.689034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.689162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.689289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.689422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.689549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.689682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.689808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.689933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.690059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.690059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.690318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.690444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.690569 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.690695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.690821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.690954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.691082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.691207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.691342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.691469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.691595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.691775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.691920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.692048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.692173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.692299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.692425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.692558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.692684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.692811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.692936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.693062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] policy.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.693188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] policy.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.693322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.693450 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.693576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.693717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.693844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.693970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.694103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] receipt.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.694231 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] receipt.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.694357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.694489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.694616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.694742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.694875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.695003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.695129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.695290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.695418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.695556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.695690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] resource.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.695841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] resource.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.695968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.696094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.696094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] resource.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.696332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] resource.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.696470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.696598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.696724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.696850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.696976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.697101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.697234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] revoke.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.697371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] revoke.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.697497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.697623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.697755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.697882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.698015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] role.cache_time = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.698142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] role.cache_time = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.698268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] role.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.698393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] role.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.698518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] role.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.698650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] role.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.698785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] role.list_limit = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.698922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] role.list_limit = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.699058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.699184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.699310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.699436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.699636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.699785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.699914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.700041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.700167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.700292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.700429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.700557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.700683 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.700809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.700946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.701080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.701213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.701340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.701466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.701600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.701732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.701867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.701995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.702123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.702123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.702362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.702494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.702646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.702775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.702903 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.703029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.703156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.703292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.703431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.703558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.703687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.703874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.704004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.704132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.704270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.704408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.704536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.704662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.704788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.704914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.705049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.705176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.705303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.705428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.705555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.705680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.705814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.705986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.706130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.706257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.706383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.706518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.706646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.706772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.706899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.707025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.707269 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.707426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] token.cache_time = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.707559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] token.cache_time = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.707686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] token.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.707835 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] token.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.707963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.708100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.708239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] token.provider = fernet {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.708368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] token.provider = fernet {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.708495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.708621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.708752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.708884 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.709020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.709148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.709275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.709401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.709527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.709653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.709796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.709924 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.710050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] trust.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.710178 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] trust.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.710305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.710432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.710566 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.710694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.711339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.711473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.711600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.711764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.711910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.712039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.712175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.712302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.712428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.712555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.712689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.712817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.713192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.connection = **** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.713324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.connection = **** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.713451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.713578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.713714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.713842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.713969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.714095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.714232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.714358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.714494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.714621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.714747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.714874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.715000 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.715127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.715262 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.715389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.715516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.715642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.715895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.716025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.716173 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.716302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.716428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.716555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.716681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.716807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.716941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.717075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.717203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.717329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.717455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.717591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.717732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.717868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.718005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.718140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:33.718268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=72578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:24:33.718396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=72579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:24:33.730131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.730366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.730593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.730900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.731136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.731362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.739203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.740079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.769181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.769490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.770029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.770264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.825338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.826478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.876727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.876984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.877127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.877317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.944170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.944403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.944630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.944852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.945072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.945360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.946620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.946855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.947081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.947300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.947520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:33.947762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.057098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.057410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.057648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.057851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.057964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.058081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.058165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.058301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.058386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.058519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.058603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.058739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.058958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.059172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.069879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.071043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.083460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.083698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.083912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=72578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.084839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.085001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.085214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=72579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:24:34.103563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.103819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 03:24:34.103954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.104156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.104285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 03:24:34.104412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 03:24:34.104559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.104691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.104818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 03:24:34.104944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.105071 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.105218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.105348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.105474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.105601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.105727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.115879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.116151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.116362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.116491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.116644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.116772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.116920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.117383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.125316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.125834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.128581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.128859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.129140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.129233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.129415 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.129517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.129695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.129788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.129951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.130043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.130218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.130321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.130487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.130578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.130749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.130841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.131016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.131116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.131277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.131386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.131549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.131841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.158576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.159134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.160178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.160456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.160766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.161050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.166656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.166868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.166971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.167151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.167310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.167556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.174507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.174784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.174910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.175152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.179194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.179478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.179677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.180557 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.180650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.180849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.180942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.181133 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.181224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.181407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.181498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.181681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.181774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.181949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.182039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.182216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.200793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.201066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.201197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.201470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.205556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.206047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.209199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.209491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.209736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.210031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.215084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.215468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.218680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.219072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.222374 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.222670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.222949 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.223140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.223270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.223438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.223578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.223727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.223856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.224012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.224290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.224584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.244633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.244917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.245050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.245176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.245302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.245454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.245583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.245709 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.253174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.253595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.254853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.255123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.255300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.255580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.258713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.258855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.258999 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.259128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.259255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.259383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.259537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.259779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.259912 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.260041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.272908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.273128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.273305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.273502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.273635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.273763 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.273982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.274182 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.274329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.274457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.274662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.274955 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.276035 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.276340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.293564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.294929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.296837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.298155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.300147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.301433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.303104 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.303231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.304903 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.305052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.305199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.305327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.305455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.305607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.312729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.312886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.314349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.314479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.317523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.317670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.317824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.317954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.318214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.318343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.318506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.318646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.328459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.328656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.328788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.328947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.329091 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.329219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.337074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=72578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.337359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.337631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.337908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.338433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.338803 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.339075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.339349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.339627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.339933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.340211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.340476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.340746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.341005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=72578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.341535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=72579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:24:34.341823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.342098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.342376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.342651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.343021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.343304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.343571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.343862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.344155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.344428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.344690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.344972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.345232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=72579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:24:34.379649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ef7fce9c0 pid: 72578 (default app) Jul 28 03:24:34.383393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d418a4-5c56-4dd4-94df-efa8dbe0fe58 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:34.383584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ef7fce9c0 pid: 72579 (default app) Jul 28 03:24:34.383753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d418a4-5c56-4dd4-94df-efa8dbe0fe58 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:34.383978 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d418a4-5c56-4dd4-94df-efa8dbe0fe58 None None] PATH_INFO: `/v3` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:34.388184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 792 bytes} [Wed Jul 28 03:24:34 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:41.950960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7682a-50de-45a9-acf4-d32d07210eb5 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:41.951511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7682a-50de-45a9-acf4-d32d07210eb5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:41.951511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7682a-50de-45a9-acf4-d32d07210eb5 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:41.956554 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:41 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:24:41.963540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:41.963972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:41.964127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:41.995356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG oslo_db.sqlalchemy.engines [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:42.193725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG passlib.handlers.bcrypt [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=72578) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 03:24:42.194144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG passlib.handlers.bcrypt [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=72578) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 03:24:42.252096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:42.253585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:42.422336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:24:42.570497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7682a-50de-45a9-acf4-d32d07210eb5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:42.610595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd7682a-50de-45a9-acf4-d32d07210eb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:42.766095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7682a-50de-45a9-acf4-d32d07210eb5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:42.770118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565b211-507e-4a79-bcab-68dad4d5fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:42.770790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565b211-507e-4a79-bcab-68dad4d5fffe admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:42.771084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565b211-507e-4a79-bcab-68dad4d5fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:42.771353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565b211-507e-4a79-bcab-68dad4d5fffe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:42.780691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565b211-507e-4a79-bcab-68dad4d5fffe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:42.844431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d565b211-507e-4a79-bcab-68dad4d5fffe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 03:24:42.844772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565b211-507e-4a79-bcab-68dad4d5fffe admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:42.854876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:24:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:24:42.861449 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:42.874928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12cada-9001-42ff-b5b0-54c6e7a7e0f9 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:42.879076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0a5dd-5abe-458d-aa2f-fe26af8b5b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:42.880206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0a5dd-5abe-458d-aa2f-fe26af8b5b04 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:42.880492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0a5dd-5abe-458d-aa2f-fe26af8b5b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:42.880763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0a5dd-5abe-458d-aa2f-fe26af8b5b04 admin admin] PATH_INFO: `/v3/projects/a74500eac66c48568f2eb64dd512dfc6` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:42.882198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0a5dd-5abe-458d-aa2f-fe26af8b5b04 admin admin] RBAC: Authorizing `identity:get_project(project_id=a74500eac66c48568f2eb64dd512dfc6)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:42.935521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2ae0a5dd-5abe-458d-aa2f-fe26af8b5b04 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 03:24:42.935884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0a5dd-5abe-458d-aa2f-fe26af8b5b04 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:42.940476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:24:42 2021] GET /identity/v3/projects/a74500eac66c48568f2eb64dd512dfc6 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:24:45.042053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523186a3-af07-4176-a52d-6ef7e8cd9182 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:45.042559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523186a3-af07-4176-a52d-6ef7e8cd9182 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:45.042639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523186a3-af07-4176-a52d-6ef7e8cd9182 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:45.047115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:45 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:24:45.053233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24864-c6f6-463b-9952-a0e7beda97e9 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:45.053595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24864-c6f6-463b-9952-a0e7beda97e9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:45.053789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24864-c6f6-463b-9952-a0e7beda97e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:45.072649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-a6f24864-c6f6-463b-9952-a0e7beda97e9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:45.074124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a6f24864-c6f6-463b-9952-a0e7beda97e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:45.081338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:24:45.105372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523186a3-af07-4176-a52d-6ef7e8cd9182 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:45.117265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523186a3-af07-4176-a52d-6ef7e8cd9182 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:45.121763 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e15d0-0900-4a6d-8430-2fc385003f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:45.122394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e15d0-0900-4a6d-8430-2fc385003f34 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:45.122675 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e15d0-0900-4a6d-8430-2fc385003f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:45.123416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e15d0-0900-4a6d-8430-2fc385003f34 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:45.130278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e15d0-0900-4a6d-8430-2fc385003f34 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:45.132081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e15d0-0900-4a6d-8430-2fc385003f34 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:45.141052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:24:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:24:45.147059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f24864-c6f6-463b-9952-a0e7beda97e9 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:45.155213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f24864-c6f6-463b-9952-a0e7beda97e9 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:45.159217 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094b6d6-e752-4be3-8c82-36a7b24e8a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:45.160103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094b6d6-e752-4be3-8c82-36a7b24e8a16 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:45.160383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094b6d6-e752-4be3-8c82-36a7b24e8a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:45.160656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094b6d6-e752-4be3-8c82-36a7b24e8a16 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:45.161974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094b6d6-e752-4be3-8c82-36a7b24e8a16 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:45.163839 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094b6d6-e752-4be3-8c82-36a7b24e8a16 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:45.165494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:24:45 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:47.348434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a08b-e509-49f9-811e-130cf61c55c6 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.349010 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a08b-e509-49f9-811e-130cf61c55c6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.349010 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a08b-e509-49f9-811e-130cf61c55c6 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.350804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:47.358601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe42204-0711-4fb9-bb0b-c2c8b5c1be79 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.359116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe42204-0711-4fb9-bb0b-c2c8b5c1be79 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.359195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe42204-0711-4fb9-bb0b-c2c8b5c1be79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.376621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0fe42204-0711-4fb9-bb0b-c2c8b5c1be79 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:47.377679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0fe42204-0711-4fb9-bb0b-c2c8b5c1be79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:47.385129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:24:47.395333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb36c2-5a6b-40c4-8ee5-6879eb543a0d None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.395619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb36c2-5a6b-40c4-8ee5-6879eb543a0d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.395928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb36c2-5a6b-40c4-8ee5-6879eb543a0d None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.397652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 6/12] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:47.404398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78542-43fb-410b-ac0c-8dcfda88a1eb None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.404685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78542-43fb-410b-ac0c-8dcfda88a1eb None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.404959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78542-43fb-410b-ac0c-8dcfda88a1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.410138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb36c2-5a6b-40c4-8ee5-6879eb543a0d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:47.422044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb36c2-5a6b-40c4-8ee5-6879eb543a0d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:47.422588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1ea78542-43fb-410b-ac0c-8dcfda88a1eb None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:47.423756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1ea78542-43fb-410b-ac0c-8dcfda88a1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:47.426036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4499a-a50f-4fc5-8810-5d7258acc240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:47.426797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4499a-a50f-4fc5-8810-5d7258acc240 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.427079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4499a-a50f-4fc5-8810-5d7258acc240 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.427351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4499a-a50f-4fc5-8810-5d7258acc240 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.430945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:24:47.442932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4499a-a50f-4fc5-8810-5d7258acc240 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:24:47.450103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-7fb4499a-a50f-4fc5-8810-5d7258acc240 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:24:47.451292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:24:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:24:47.453861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78542-43fb-410b-ac0c-8dcfda88a1eb None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:47.457486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4499a-a50f-4fc5-8810-5d7258acc240 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:47.462626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78542-43fb-410b-ac0c-8dcfda88a1eb None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:47.467072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd332a7-a333-40de-a1ca-035a9cf01390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:47.467426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4499a-a50f-4fc5-8810-5d7258acc240 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:47.467735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd332a7-a333-40de-a1ca-035a9cf01390 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.468026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd332a7-a333-40de-a1ca-035a9cf01390 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.468308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd332a7-a333-40de-a1ca-035a9cf01390 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.471529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:47.472202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.472509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.472787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.473865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:24:47.474191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:47.475573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd332a7-a333-40de-a1ca-035a9cf01390 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:47.475931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:47.475931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:24:47.475931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:24:47.477920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:47.478018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd332a7-a333-40de-a1ca-035a9cf01390 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:47.486323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:24:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:24:47.492204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd332a7-a333-40de-a1ca-035a9cf01390 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:47.493029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:24:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:24:47.499081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:47.499946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd332a7-a333-40de-a1ca-035a9cf01390 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:47.504063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc1a61-c3fa-4189-8a7a-6f74721d1ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:47.504832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc1a61-c3fa-4189-8a7a-6f74721d1ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.505114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc1a61-c3fa-4189-8a7a-6f74721d1ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.505388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc1a61-c3fa-4189-8a7a-6f74721d1ce4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.506518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc1a61-c3fa-4189-8a7a-6f74721d1ce4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:47.508776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f44fab-1767-41df-8350-b4fa48c1e248 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:47.509023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc1a61-c3fa-4189-8a7a-6f74721d1ce4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:47.510511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:24:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:24:47.512897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f76a7-e30d-4db3-8955-3a26a0cfa943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:47.513743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f76a7-e30d-4db3-8955-3a26a0cfa943 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.514023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f76a7-e30d-4db3-8955-3a26a0cfa943 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.514294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f76a7-e30d-4db3-8955-3a26a0cfa943 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.516022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f76a7-e30d-4db3-8955-3a26a0cfa943 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:47.517903 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f76a7-e30d-4db3-8955-3a26a0cfa943 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:47.519548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:24:47 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:24:47.526732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc1a61-c3fa-4189-8a7a-6f74721d1ce4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:47.536249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc1a61-c3fa-4189-8a7a-6f74721d1ce4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:47.540743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5abff2-c843-42d0-a95f-468a2fb387a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:47.541559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5abff2-c843-42d0-a95f-468a2fb387a5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.541842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5abff2-c843-42d0-a95f-468a2fb387a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.542121 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5abff2-c843-42d0-a95f-468a2fb387a5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.543291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5abff2-c843-42d0-a95f-468a2fb387a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:47.545089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5abff2-c843-42d0-a95f-468a2fb387a5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:47.546703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:24:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:47.553333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f76a7-e30d-4db3-8955-3a26a0cfa943 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:47.563897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f76a7-e30d-4db3-8955-3a26a0cfa943 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:47.568162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426ec55-b45a-45bc-909c-ef0f43df13b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:47.568840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426ec55-b45a-45bc-909c-ef0f43df13b9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:47.569120 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426ec55-b45a-45bc-909c-ef0f43df13b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:47.569396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426ec55-b45a-45bc-909c-ef0f43df13b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:47.571475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426ec55-b45a-45bc-909c-ef0f43df13b9 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.domain.id=default, user.id=398ba2372d694a5b8498f1f6df8ec46d) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:24:47.571818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426ec55-b45a-45bc-909c-ef0f43df13b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:47.572845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-e426ec55-b45a-45bc-909c-ef0f43df13b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:47.572845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:24:47.572845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:24:47.574048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426ec55-b45a-45bc-909c-ef0f43df13b9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:47.583538 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1344 bytes} [Wed Jul 28 03:24:47 2021] GET /identity/v3/role_assignments?user.id=398ba2372d694a5b8498f1f6df8ec46d&scope.domain.id=default&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:49.833323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a970fc6-e05a-4ffd-98cc-f07e3638c95b None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:49.833833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a970fc6-e05a-4ffd-98cc-f07e3638c95b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:49.833833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a970fc6-e05a-4ffd-98cc-f07e3638c95b None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:49.837017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:49.842935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:49.843345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:49.843514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:49.887627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG passlib.handlers.bcrypt [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=72579) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 03:24:49.892206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG passlib.handlers.bcrypt [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=72579) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 03:24:49.942471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:49.948098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:49.995465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 11/22] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:24:50.031894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a970fc6-e05a-4ffd-98cc-f07e3638c95b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.050126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a970fc6-e05a-4ffd-98cc-f07e3638c95b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.054280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10945dc3-c6f6-4e88-9cda-81fc3ea6314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.055246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10945dc3-c6f6-4e88-9cda-81fc3ea6314b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.055544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10945dc3-c6f6-4e88-9cda-81fc3ea6314b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.055809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10945dc3-c6f6-4e88-9cda-81fc3ea6314b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.071113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10945dc3-c6f6-4e88-9cda-81fc3ea6314b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:24:50.078220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-10945dc3-c6f6-4e88-9cda-81fc3ea6314b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:24:50.079814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 12/23] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:24:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:24:50.086214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.095425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5581a-3953-48df-b14a-f4171792a5f0 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.103962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.104982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.105264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.105540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.106451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:24:50.106753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.108466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.123685 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 12/24] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:24:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:50.130150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10945dc3-c6f6-4e88-9cda-81fc3ea6314b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.141129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10945dc3-c6f6-4e88-9cda-81fc3ea6314b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.152600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f008-7bb0-4ba4-8383-e6c8023b5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.153517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f008-7bb0-4ba4-8383-e6c8023b5b78 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.153793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f008-7bb0-4ba4-8383-e6c8023b5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.154102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f008-7bb0-4ba4-8383-e6c8023b5b78 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.155408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56f008-7bb0-4ba4-8383-e6c8023b5b78 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.157617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56f008-7bb0-4ba4-8383-e6c8023b5b78 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.159688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 13/25] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:24:50 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:50.167635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.177711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7069d-a15a-468c-a8ca-7dfc41068ab7 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.193039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0f3fd-ee1c-4dfc-943f-316d02697880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.193872 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f3fd-ee1c-4dfc-943f-316d02697880 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.194159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f3fd-ee1c-4dfc-943f-316d02697880 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.194437 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f3fd-ee1c-4dfc-943f-316d02697880 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.200697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f3fd-ee1c-4dfc-943f-316d02697880 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.202475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f3fd-ee1c-4dfc-943f-316d02697880 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.204431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 13/26] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:24:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:50.211012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f008-7bb0-4ba4-8383-e6c8023b5b78 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.224346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f008-7bb0-4ba4-8383-e6c8023b5b78 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.230098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834598c-10b7-4882-84f9-049bce31d05d None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.230565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834598c-10b7-4882-84f9-049bce31d05d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.231009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834598c-10b7-4882-84f9-049bce31d05d None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.233205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:50.234470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.234864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.235228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.235575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] PATH_INFO: `/v3/domains/default/users/398ba2372d694a5b8498f1f6df8ec46d/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.237564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=398ba2372d694a5b8498f1f6df8ec46d, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.239302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:50.239302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:24:50.239302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:24:50.240479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8330ff0-c8ef-4351-9a43-f224ddb8c64c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.240967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8330ff0-c8ef-4351-9a43-f224ddb8c64c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.241298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.241697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8330ff0-c8ef-4351-9a43-f224ddb8c64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.276776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c8330ff0-c8ef-4351-9a43-f224ddb8c64c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:50.278298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c8330ff0-c8ef-4351-9a43-f224ddb8c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:50.411294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:24:50.448587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8330ff0-c8ef-4351-9a43-f224ddb8c64c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.459929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 14/29] 10.222.0.16 () {58 vars in 1383 bytes} [Wed Jul 28 03:24:50 2021] PUT /identity/v3/domains/default/users/398ba2372d694a5b8498f1f6df8ec46d/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:24:50.464432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8330ff0-c8ef-4351-9a43-f224ddb8c64c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.469302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ddf7b-9f19-48f0-a076-eaf00d60a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.470405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ddf7b-9f19-48f0-a076-eaf00d60a774 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.470863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ddf7b-9f19-48f0-a076-eaf00d60a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.471294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ddf7b-9f19-48f0-a076-eaf00d60a774 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.485965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ddf7b-9f19-48f0-a076-eaf00d60a774 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.488255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ddf7b-9f19-48f0-a076-eaf00d60a774 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.506528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-264ddf7b-9f19-48f0-a076-eaf00d60a774 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:24:50.508967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:24:50.516298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.525979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee07fa-6558-40ac-8cb4-30a4f438a1c8 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.526274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee07fa-6558-40ac-8cb4-30a4f438a1c8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.526973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee07fa-6558-40ac-8cb4-30a4f438a1c8 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.528729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 17/31] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:50.530863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a9130-89f8-4ce0-a702-dcceef0ca517 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.535560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.536430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.536856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.537191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668cb9-488c-4971-92ed-1dd4d98d5f0e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.537455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.537560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668cb9-488c-4971-92ed-1dd4d98d5f0e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.537743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668cb9-488c-4971-92ed-1dd4d98d5f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.539138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:24:50.539908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.541445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:50.541445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:24:50.541445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:24:50.542636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.565307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 15/32] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:50.572046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.576802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3f668cb9-488c-4971-92ed-1dd4d98d5f0e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:50.578058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3f668cb9-488c-4971-92ed-1dd4d98d5f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:50.582168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85185aa7-3e43-4b1a-a0cb-7f8c7716544f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.587082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a79684-72e1-447e-a881-bad131b9a19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.588424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79684-72e1-447e-a881-bad131b9a19c admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.589005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79684-72e1-447e-a881-bad131b9a19c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.589456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79684-72e1-447e-a881-bad131b9a19c admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.590450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a79684-72e1-447e-a881-bad131b9a19c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.591820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-63a79684-72e1-447e-a881-bad131b9a19c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:50.591820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:24:50.591820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:24:50.593618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a79684-72e1-447e-a881-bad131b9a19c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.594860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 18/33] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:24:50.628830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 16/34] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:24:50 2021] POST /identity/v3/projects => generated 301 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:24:50.638875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668cb9-488c-4971-92ed-1dd4d98d5f0e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.648849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668cb9-488c-4971-92ed-1dd4d98d5f0e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.741328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc55b45-2187-4ed9-8679-5b66f642ebc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.743015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55b45-2187-4ed9-8679-5b66f642ebc2 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.743601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55b45-2187-4ed9-8679-5b66f642ebc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.744095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55b45-2187-4ed9-8679-5b66f642ebc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.745068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc55b45-2187-4ed9-8679-5b66f642ebc2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.746317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-ccc55b45-2187-4ed9-8679-5b66f642ebc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:50.746317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:24:50.746317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:24:50.747580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc55b45-2187-4ed9-8679-5b66f642ebc2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.843527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e29dc-2b88-4631-bd4b-28bb308fcac5 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.844494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e29dc-2b88-4631-bd4b-28bb308fcac5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.845015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e29dc-2b88-4631-bd4b-28bb308fcac5 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.847247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 17/35] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:24:50.853336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9074e-4815-4ff0-a4ef-79d63f015dd9 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.853833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9074e-4815-4ff0-a4ef-79d63f015dd9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.854114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9074e-4815-4ff0-a4ef-79d63f015dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.891937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-55d9074e-4815-4ff0-a4ef-79d63f015dd9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:50.893838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-55d9074e-4815-4ff0-a4ef-79d63f015dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:50.912351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 18/36] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:24:50.953092 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9074e-4815-4ff0-a4ef-79d63f015dd9 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:50.966957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9074e-4815-4ff0-a4ef-79d63f015dd9 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:50.973453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6db75-a9a3-4adb-8c9a-8cdeea6e13bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:50.974398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6db75-a9a3-4adb-8c9a-8cdeea6e13bf admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:50.974927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6db75-a9a3-4adb-8c9a-8cdeea6e13bf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:50.975404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6db75-a9a3-4adb-8c9a-8cdeea6e13bf admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:50.977005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6db75-a9a3-4adb-8c9a-8cdeea6e13bf admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:50.978310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-0dc6db75-a9a3-4adb-8c9a-8cdeea6e13bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:50.978310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:24:50.978310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:24:50.984002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6db75-a9a3-4adb-8c9a-8cdeea6e13bf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:50.986154 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:24:50 2021] POST /identity/v3/roles => generated 225 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:24:51.021719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 19/38] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:24:50 2021] POST /identity/v3/roles => generated 219 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:24:51.731621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3c74-3b83-41ae-a267-c57195bd52d1 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:51.732021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3c74-3b83-41ae-a267-c57195bd52d1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:51.732208 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3c74-3b83-41ae-a267-c57195bd52d1 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:51.733999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 20/39] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:24:51.740283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3a23-29d5-4643-8243-1d19088fc387 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:51.740688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3a23-29d5-4643-8243-1d19088fc387 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:51.741096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3a23-29d5-4643-8243-1d19088fc387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:51.760737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1c3f3a23-29d5-4643-8243-1d19088fc387 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:51.761898 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1c3f3a23-29d5-4643-8243-1d19088fc387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:51.768898 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:24:51.793543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3c74-3b83-41ae-a267-c57195bd52d1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:51.805939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3c74-3b83-41ae-a267-c57195bd52d1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:51.810116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732d7e2-5b2c-407e-b826-88194a9ffbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:51.810790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732d7e2-5b2c-407e-b826-88194a9ffbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:51.811076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732d7e2-5b2c-407e-b826-88194a9ffbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:51.811351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732d7e2-5b2c-407e-b826-88194a9ffbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:51.812146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732d7e2-5b2c-407e-b826-88194a9ffbf6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:51.814039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732d7e2-5b2c-407e-b826-88194a9ffbf6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:51.830039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:24:51 2021] POST /identity/v3/roles => generated 223 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:24:52.006710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb341-7d54-44bc-86d8-2f9dfa280c4a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:52.007206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb341-7d54-44bc-86d8-2f9dfa280c4a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:52.007206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb341-7d54-44bc-86d8-2f9dfa280c4a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:52.010298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 21/42] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:52.016613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7a54-8ed3-4b5d-81cb-7053e0199423 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:52.017030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7a54-8ed3-4b5d-81cb-7053e0199423 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:52.017216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7a54-8ed3-4b5d-81cb-7053e0199423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:52.037172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d8ec7a54-8ed3-4b5d-81cb-7053e0199423 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:52.038694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d8ec7a54-8ed3-4b5d-81cb-7053e0199423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:52.046438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:24:52.075957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eb341-7d54-44bc-86d8-2f9dfa280c4a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:52.089933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eb341-7d54-44bc-86d8-2f9dfa280c4a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:52.093939 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c3759-a82b-4e2a-9459-ab950b2f46b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:52.094720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3759-a82b-4e2a-9459-ab950b2f46b8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:52.095008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3759-a82b-4e2a-9459-ab950b2f46b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:52.095287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3759-a82b-4e2a-9459-ab950b2f46b8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:52.096438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c3759-a82b-4e2a-9459-ab950b2f46b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:52.098150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c3759-a82b-4e2a-9459-ab950b2f46b8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:52.099673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 22/44] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:24:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:52.105573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7a54-8ed3-4b5d-81cb-7053e0199423 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:52.113998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7a54-8ed3-4b5d-81cb-7053e0199423 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:52.118232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5e9f5-e2a1-44e7-8bf1-d560e27b537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:52.118897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e9f5-e2a1-44e7-8bf1-d560e27b537d admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:52.119188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e9f5-e2a1-44e7-8bf1-d560e27b537d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:52.119470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e9f5-e2a1-44e7-8bf1-d560e27b537d admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:52.120235 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e9f5-e2a1-44e7-8bf1-d560e27b537d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:52.121256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-57f5e9f5-e2a1-44e7-8bf1-d560e27b537d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:52.121256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:24:52.121256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:24:52.122481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e9f5-e2a1-44e7-8bf1-d560e27b537d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:52.149595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:24:52 2021] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:24:52.929902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455495e-1df8-4a62-9faa-cea20a72ff7b None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:52.930182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455495e-1df8-4a62-9faa-cea20a72ff7b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:52.930459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455495e-1df8-4a62-9faa-cea20a72ff7b None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:52.932278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 23/46] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:52.938195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bbdc8-13b6-4f83-be47-e80c27f655ff None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:52.938491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bbdc8-13b6-4f83-be47-e80c27f655ff None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:52.938778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bbdc8-13b6-4f83-be47-e80c27f655ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:52.956189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e21bbdc8-13b6-4f83-be47-e80c27f655ff None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:52.957341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e21bbdc8-13b6-4f83-be47-e80c27f655ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:53.012866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 24/47] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:24:53.037149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455495e-1df8-4a62-9faa-cea20a72ff7b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:53.049098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455495e-1df8-4a62-9faa-cea20a72ff7b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:53.053056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb2f3-e486-4ae3-88a9-6e13e77a5e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:53.053838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb2f3-e486-4ae3-88a9-6e13e77a5e69 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:53.054127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb2f3-e486-4ae3-88a9-6e13e77a5e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:53.055015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb2f3-e486-4ae3-88a9-6e13e77a5e69 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:53.064834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb2f3-e486-4ae3-88a9-6e13e77a5e69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:24:53.072036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-b90bb2f3-e486-4ae3-88a9-6e13e77a5e69 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:24:53.073210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:24:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:24:53.079532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bbdc8-13b6-4f83-be47-e80c27f655ff None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:53.088970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bbdc8-13b6-4f83-be47-e80c27f655ff None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:53.093139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:53.093801 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:53.094088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:53.094367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:53.095116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:24:53.095423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:53.097099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:53.105523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:24:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:24:53.111379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb2f3-e486-4ae3-88a9-6e13e77a5e69 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:53.123489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb2f3-e486-4ae3-88a9-6e13e77a5e69 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:53.127219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795742d-602b-44ad-9b4e-db7a6b55066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:53.128131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795742d-602b-44ad-9b4e-db7a6b55066a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:53.128414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795742d-602b-44ad-9b4e-db7a6b55066a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:53.128688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795742d-602b-44ad-9b4e-db7a6b55066a admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:53.129824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795742d-602b-44ad-9b4e-db7a6b55066a admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:53.131641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795742d-602b-44ad-9b4e-db7a6b55066a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:53.134368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:24:53 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:53.140248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:53.149489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2484a3-2a8e-494c-acb0-cdc915ec54f5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:53.153642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c89a99-f5c4-41b8-bc55-0b6bc3171e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:53.154431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c89a99-f5c4-41b8-bc55-0b6bc3171e52 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:53.154719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c89a99-f5c4-41b8-bc55-0b6bc3171e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:53.155002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c89a99-f5c4-41b8-bc55-0b6bc3171e52 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:53.156173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c89a99-f5c4-41b8-bc55-0b6bc3171e52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:53.157895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c89a99-f5c4-41b8-bc55-0b6bc3171e52 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:53.159431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:24:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:53.165879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795742d-602b-44ad-9b4e-db7a6b55066a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:53.174940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795742d-602b-44ad-9b4e-db7a6b55066a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:53.179030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28757e60-a7f4-49d8-a0bd-c1cc83ef21e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:53.180468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28757e60-a7f4-49d8-a0bd-c1cc83ef21e5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:53.180615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28757e60-a7f4-49d8-a0bd-c1cc83ef21e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:53.180886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28757e60-a7f4-49d8-a0bd-c1cc83ef21e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:53.181716 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28757e60-a7f4-49d8-a0bd-c1cc83ef21e5 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.domain.id=default, user.id=398ba2372d694a5b8498f1f6df8ec46d) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:24:53.182029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28757e60-a7f4-49d8-a0bd-c1cc83ef21e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:53.183053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-28757e60-a7f4-49d8-a0bd-c1cc83ef21e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:53.183053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:24:53.183053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:24:53.184245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28757e60-a7f4-49d8-a0bd-c1cc83ef21e5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:53.191350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 26/52] 10.222.0.16 () {56 vars in 1344 bytes} [Wed Jul 28 03:24:53 2021] GET /identity/v3/role_assignments?user.id=398ba2372d694a5b8498f1f6df8ec46d&scope.domain.id=default&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:54.297527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55838ca3-5e61-4cd4-9467-eaadce45e32e None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:54.298037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55838ca3-5e61-4cd4-9467-eaadce45e32e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:54.298121 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55838ca3-5e61-4cd4-9467-eaadce45e32e None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:54.299862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 27/53] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:54.305707 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b96a-dd73-4fff-b395-6f2b08fe7e76 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:54.306104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b96a-dd73-4fff-b395-6f2b08fe7e76 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:54.306263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b96a-dd73-4fff-b395-6f2b08fe7e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:54.323462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d1d8b96a-dd73-4fff-b395-6f2b08fe7e76 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:54.324648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d1d8b96a-dd73-4fff-b395-6f2b08fe7e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:54.331476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:24:54.356384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55838ca3-5e61-4cd4-9467-eaadce45e32e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:54.368238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55838ca3-5e61-4cd4-9467-eaadce45e32e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:54.372230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c545-bdf3-4c4e-afc4-34ae7c806ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:54.373054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c545-bdf3-4c4e-afc4-34ae7c806ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:54.373293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c545-bdf3-4c4e-afc4-34ae7c806ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:54.373574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c545-bdf3-4c4e-afc4-34ae7c806ef6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:54.374707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c545-bdf3-4c4e-afc4-34ae7c806ef6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:54.376461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c545-bdf3-4c4e-afc4-34ae7c806ef6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:54.377978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:24:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:54.383671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b96a-dd73-4fff-b395-6f2b08fe7e76 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:54.391610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b96a-dd73-4fff-b395-6f2b08fe7e76 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:54.395766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ecff5-78ce-4e3f-b203-8839ea07f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:54.396404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ecff5-78ce-4e3f-b203-8839ea07f7ed admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:54.396689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ecff5-78ce-4e3f-b203-8839ea07f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:54.396965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ecff5-78ce-4e3f-b203-8839ea07f7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:54.397649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ecff5-78ce-4e3f-b203-8839ea07f7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:54.399696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ecff5-78ce-4e3f-b203-8839ea07f7ed admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:54.423525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 28/56] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Jul 28 03:24:54 2021] POST /identity/v3/projects => generated 298 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:24:56.525034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881836-b0d3-48b7-ae88-9deacc1e1b85 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:56.525535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881836-b0d3-48b7-ae88-9deacc1e1b85 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:56.525535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881836-b0d3-48b7-ae88-9deacc1e1b85 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:56.527260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 29/57] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:24:56.532974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5db7-7ea4-41ff-9244-2a94a82a0456 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:56.533336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5db7-7ea4-41ff-9244-2a94a82a0456 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:56.533537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5db7-7ea4-41ff-9244-2a94a82a0456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:56.550819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-dfec5db7-7ea4-41ff-9244-2a94a82a0456 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:24:56.551980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-dfec5db7-7ea4-41ff-9244-2a94a82a0456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:24:56.604843 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 29/58] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:24:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:24:56.628899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb881836-b0d3-48b7-ae88-9deacc1e1b85 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:56.640741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb881836-b0d3-48b7-ae88-9deacc1e1b85 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:56.644663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baddc3-4e42-45c6-a4a8-6fe03b8fcd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:56.645435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baddc3-4e42-45c6-a4a8-6fe03b8fcd61 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:56.645713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baddc3-4e42-45c6-a4a8-6fe03b8fcd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:56.645985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baddc3-4e42-45c6-a4a8-6fe03b8fcd61 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:56.647097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baddc3-4e42-45c6-a4a8-6fe03b8fcd61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:56.649642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baddc3-4e42-45c6-a4a8-6fe03b8fcd61 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:56.651134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:24:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:24:56.656563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec5db7-7ea4-41ff-9244-2a94a82a0456 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:24:56.664517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec5db7-7ea4-41ff-9244-2a94a82a0456 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:24:56.668548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180af6b-6dac-4251-91dd-892b6dcbd488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:24:56.669194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180af6b-6dac-4251-91dd-892b6dcbd488 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:56.669478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180af6b-6dac-4251-91dd-892b6dcbd488 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:56.669752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180af6b-6dac-4251-91dd-892b6dcbd488 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:24:56.670454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180af6b-6dac-4251-91dd-892b6dcbd488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:24:56.671455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-a180af6b-6dac-4251-91dd-892b6dcbd488 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:24:56.671455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:24:56.671455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:24:56.672700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180af6b-6dac-4251-91dd-892b6dcbd488 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:24:56.697335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 30/60] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:24:56 2021] POST /identity/v3/users => generated 275 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:24:59.998181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308beb5-5a8c-433e-80f9-9046337d8c2b None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:24:59.999188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308beb5-5a8c-433e-80f9-9046337d8c2b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:24:59.999756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308beb5-5a8c-433e-80f9-9046337d8c2b None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.001997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 31/61] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:24:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:00.009492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac9d93-6c8f-4232-9aa1-9d8776c49f0e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.010006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac9d93-6c8f-4232-9aa1-9d8776c49f0e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.010080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac9d93-6c8f-4232-9aa1-9d8776c49f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.036025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8dac9d93-6c8f-4232-9aa1-9d8776c49f0e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:00.037242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8dac9d93-6c8f-4232-9aa1-9d8776c49f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:00.050650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 31/62] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:00.087692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc8c9-64c7-418b-9f54-903c0af07e9a None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.088593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac9d93-6c8f-4232-9aa1-9d8776c49f0e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.088724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc8c9-64c7-418b-9f54-903c0af07e9a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.089211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc8c9-64c7-418b-9f54-903c0af07e9a None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.091508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:00.100915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40e90b-9182-447f-ae0a-7e89ac44de56 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.101563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac9d93-6c8f-4232-9aa1-9d8776c49f0e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.101719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40e90b-9182-447f-ae0a-7e89ac44de56 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.102022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40e90b-9182-447f-ae0a-7e89ac44de56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.110700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21c94-522d-4ef5-aae4-8f0767855ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.111513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21c94-522d-4ef5-aae4-8f0767855ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.111827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21c94-522d-4ef5-aae4-8f0767855ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.112109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21c94-522d-4ef5-aae4-8f0767855ac3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.126853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1d40e90b-9182-447f-ae0a-7e89ac44de56 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:00.128058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1d40e90b-9182-447f-ae0a-7e89ac44de56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:00.136567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f21c94-522d-4ef5-aae4-8f0767855ac3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:00.143354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-78f21c94-522d-4ef5-aae4-8f0767855ac3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:00.150075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:00.150287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 32/65] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:00.157392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40e90b-9182-447f-ae0a-7e89ac44de56 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.167266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40e90b-9182-447f-ae0a-7e89ac44de56 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.175138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.175850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.176141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.176418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.177177 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:00.177484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.179410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.192377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 34/66] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.195421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21c94-522d-4ef5-aae4-8f0767855ac3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.199156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.205127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21c94-522d-4ef5-aae4-8f0767855ac3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.208433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63913d-9537-4881-ac8e-56d9f0ae4417 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.216842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d03e-3add-4d9d-a7f7-8a8a062d3540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.217647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d03e-3add-4d9d-a7f7-8a8a062d3540 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.217930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d03e-3add-4d9d-a7f7-8a8a062d3540 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.218206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d03e-3add-4d9d-a7f7-8a8a062d3540 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.219184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94affbba-40e4-457b-b4af-223e32dbfc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.220075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94affbba-40e4-457b-b4af-223e32dbfc6b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.220353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94affbba-40e4-457b-b4af-223e32dbfc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.220623 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94affbba-40e4-457b-b4af-223e32dbfc6b admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.250083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94affbba-40e4-457b-b4af-223e32dbfc6b admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.252274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94affbba-40e4-457b-b4af-223e32dbfc6b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.252468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91d03e-3add-4d9d-a7f7-8a8a062d3540 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:00.254359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 35/67] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.260178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-cd91d03e-3add-4d9d-a7f7-8a8a062d3540 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:00.265776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 33/68] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:00.268186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94affbba-40e4-457b-b4af-223e32dbfc6b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.281699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94affbba-40e4-457b-b4af-223e32dbfc6b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.283700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d03e-3add-4d9d-a7f7-8a8a062d3540 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.291852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ffade-69bd-4b1a-a793-990429602e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.292816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ffade-69bd-4b1a-a793-990429602e46 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.293298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ffade-69bd-4b1a-a793-990429602e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.293781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ffade-69bd-4b1a-a793-990429602e46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.296501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d03e-3add-4d9d-a7f7-8a8a062d3540 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.300794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.301462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.301748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.302019 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.302919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:00.303361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ffade-69bd-4b1a-a793-990429602e46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.303514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.304786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:00.304786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:00.304786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:00.305703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ffade-69bd-4b1a-a793-990429602e46 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.306120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.314572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 36/69] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:00.320817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec572bd-f8a9-4fe2-b710-cb878c95d0c8 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.320947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 34/70] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:00.321405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec572bd-f8a9-4fe2-b710-cb878c95d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.321842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec572bd-f8a9-4fe2-b710-cb878c95d0c8 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.323429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.327648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 37/71] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:00 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:00.328859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec572bd-f8a9-4fe2-b710-cb878c95d0c8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.336981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51abc32-a33f-4f0e-8853-a35da0367270 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.341915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6284b7-d32f-49f9-9715-1d3e03e8e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.343087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6284b7-d32f-49f9-9715-1d3e03e8e943 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.343568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6284b7-d32f-49f9-9715-1d3e03e8e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.344076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6284b7-d32f-49f9-9715-1d3e03e8e943 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.345385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec572bd-f8a9-4fe2-b710-cb878c95d0c8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.345805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6284b7-d32f-49f9-9715-1d3e03e8e943 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.348551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6284b7-d32f-49f9-9715-1d3e03e8e943 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.349604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87d1d8-f2ef-4b97-a593-cd1a263c23f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.350467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d1d8-f2ef-4b97-a593-cd1a263c23f9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.350753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d1d8-f2ef-4b97-a593-cd1a263c23f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.351635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d1d8-f2ef-4b97-a593-cd1a263c23f9 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.352291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 35/72] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.353646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba31ac-97b4-4f1a-aa57-f14c63b3cc91 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.354123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba31ac-97b4-4f1a-aa57-f14c63b3cc91 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.354592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba31ac-97b4-4f1a-aa57-f14c63b3cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.358546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87d1d8-f2ef-4b97-a593-cd1a263c23f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.360540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87d1d8-f2ef-4b97-a593-cd1a263c23f9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.367766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 38/73] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.367766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87d1d8-f2ef-4b97-a593-cd1a263c23f9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.374454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87d1d8-f2ef-4b97-a593-cd1a263c23f9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.379474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.380274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.380565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.380841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.381593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-01ba31ac-97b4-4f1a-aa57-f14c63b3cc91 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:00.381713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] RBAC: Adding query filter params (role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user.id=beb11f34c6cf46fe9a631e0e48e77875) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:00.381978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.383453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-01ba31ac-97b4-4f1a-aa57-f14c63b3cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:00.383925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.390615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 39/74] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/role_assignments?user.id=beb11f34c6cf46fe9a631e0e48e77875&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.391793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 36/75] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:00.396815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.407036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f957-a52a-4e73-b567-570faebf151c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.412111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcdd16-0098-4426-928e-88abc9754b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.413212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcdd16-0098-4426-928e-88abc9754b2e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.414461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcdd16-0098-4426-928e-88abc9754b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.415019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcdd16-0098-4426-928e-88abc9754b2e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.424441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcdd16-0098-4426-928e-88abc9754b2e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.426630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcdd16-0098-4426-928e-88abc9754b2e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.436452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 40/76] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:00.444383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba31ac-97b4-4f1a-aa57-f14c63b3cc91 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.454553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcdd16-0098-4426-928e-88abc9754b2e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.461659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba31ac-97b4-4f1a-aa57-f14c63b3cc91 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.468326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee402c8-52c1-4817-bb3e-20f838333a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.468918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcdd16-0098-4426-928e-88abc9754b2e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.469166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee402c8-52c1-4817-bb3e-20f838333a97 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.469450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee402c8-52c1-4817-bb3e-20f838333a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.469725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee402c8-52c1-4817-bb3e-20f838333a97 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.474293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd712651-d594-48a9-9b1d-9789c0e8f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.475527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712651-d594-48a9-9b1d-9789c0e8f89d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.476742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712651-d594-48a9-9b1d-9789c0e8f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.477233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712651-d594-48a9-9b1d-9789c0e8f89d admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.478807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd712651-d594-48a9-9b1d-9789c0e8f89d admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.481138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd712651-d594-48a9-9b1d-9789c0e8f89d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.483158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 41/77] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.484436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4594-dbe4-4175-a8e9-8dcc3597461f None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.484681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4594-dbe4-4175-a8e9-8dcc3597461f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.484919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4594-dbe4-4175-a8e9-8dcc3597461f None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.486939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 42/78] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:00.493150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4594-dbe4-4175-a8e9-8dcc3597461f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.495868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee402c8-52c1-4817-bb3e-20f838333a97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:00.503547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-1ee402c8-52c1-4817-bb3e-20f838333a97 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:00.510504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 37/79] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:00.510504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82ebf5-e596-4b07-90c3-838bd0a4b56d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.510504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82ebf5-e596-4b07-90c3-838bd0a4b56d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.510504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82ebf5-e596-4b07-90c3-838bd0a4b56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.514124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4594-dbe4-4175-a8e9-8dcc3597461f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.520100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63621ed7-0044-4c45-852f-25f063a33b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.521059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621ed7-0044-4c45-852f-25f063a33b59 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.522205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621ed7-0044-4c45-852f-25f063a33b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.522737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621ed7-0044-4c45-852f-25f063a33b59 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.524248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63621ed7-0044-4c45-852f-25f063a33b59 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user.id=398ba2372d694a5b8498f1f6df8ec46d) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:00.524743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63621ed7-0044-4c45-852f-25f063a33b59 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.526863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63621ed7-0044-4c45-852f-25f063a33b59 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.528094 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-cd82ebf5-e596-4b07-90c3-838bd0a4b56d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:00.529337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cd82ebf5-e596-4b07-90c3-838bd0a4b56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:00.539768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 38/81] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:00.539768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82ebf5-e596-4b07-90c3-838bd0a4b56d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.540146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 43/81] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/role_assignments?user.id=398ba2372d694a5b8498f1f6df8ec46d&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.563432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82ebf5-e596-4b07-90c3-838bd0a4b56d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.571833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ed1b-872f-4dcd-83e5-6c4f858bed7d None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.572351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ed1b-872f-4dcd-83e5-6c4f858bed7d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.572764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.572927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ed1b-872f-4dcd-83e5-6c4f858bed7d None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.573456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.573739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.574014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.574773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:00.575075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.576799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.576977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 44/82] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:00.581951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8446-9877-4d20-864b-3c4012cf10c3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.582461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8446-9877-4d20-864b-3c4012cf10c3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.583507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8446-9877-4d20-864b-3c4012cf10c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.588959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 39/83] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.589179 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.598495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cc00d-a593-498f-88e4-59ca2ddb1859 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.604942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b21c3-62d2-4bd0-b6fb-c9232aa909d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.605833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b21c3-62d2-4bd0-b6fb-c9232aa909d5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.606116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b21c3-62d2-4bd0-b6fb-c9232aa909d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.606389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b21c3-62d2-4bd0-b6fb-c9232aa909d5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.607664 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b21c3-62d2-4bd0-b6fb-c9232aa909d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.610159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b21c3-62d2-4bd0-b6fb-c9232aa909d5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.612412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 40/84] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.613229 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b21c3-62d2-4bd0-b6fb-c9232aa909d5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.613830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f85d8446-9877-4d20-864b-3c4012cf10c3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:00.615281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f85d8446-9877-4d20-864b-3c4012cf10c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:00.623798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b21c3-62d2-4bd0-b6fb-c9232aa909d5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.626149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 45/85] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:00.626995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d8446-9877-4d20-864b-3c4012cf10c3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.628405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1fd20-11df-4fe7-b6ec-a09f61772b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.629367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1fd20-11df-4fe7-b6ec-a09f61772b8f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.629721 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1fd20-11df-4fe7-b6ec-a09f61772b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.630067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1fd20-11df-4fe7-b6ec-a09f61772b8f admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.631329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1fd20-11df-4fe7-b6ec-a09f61772b8f admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.634153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1fd20-11df-4fe7-b6ec-a09f61772b8f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.635936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 41/86] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.637229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d8446-9877-4d20-864b-3c4012cf10c3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.642451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1fd20-11df-4fe7-b6ec-a09f61772b8f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.642677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa32989-c0cb-4fb2-b4f0-f78ff85a3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.643402 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa32989-c0cb-4fb2-b4f0-f78ff85a3882 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.643692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa32989-c0cb-4fb2-b4f0-f78ff85a3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.644204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa32989-c0cb-4fb2-b4f0-f78ff85a3882 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.644928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa32989-c0cb-4fb2-b4f0-f78ff85a3882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.648383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa32989-c0cb-4fb2-b4f0-f78ff85a3882 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.653734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1fd20-11df-4fe7-b6ec-a09f61772b8f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.658127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd717ac-2025-42f3-a63e-761284b4c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.658799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd717ac-2025-42f3-a63e-761284b4c26d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.659100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd717ac-2025-42f3-a63e-761284b4c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.659375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd717ac-2025-42f3-a63e-761284b4c26d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.673944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd717ac-2025-42f3-a63e-761284b4c26d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.675893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd717ac-2025-42f3-a63e-761284b4c26d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.691789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:00.691789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd717ac-2025-42f3-a63e-761284b4c26d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.692471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 46/88] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:25:00 2021] POST /identity/v3/projects => generated 302 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:00.700290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd717ac-2025-42f3-a63e-761284b4c26d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.704751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa32989-c0cb-4fb2-b4f0-f78ff85a3882 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.765272 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b500-7e52-4afc-b340-37697401fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.766117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b500-7e52-4afc-b340-37697401fae9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.766474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b500-7e52-4afc-b340-37697401fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.766822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b500-7e52-4afc-b340-37697401fae9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.778978 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891b500-7e52-4afc-b340-37697401fae9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:00.786259 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-b891b500-7e52-4afc-b340-37697401fae9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:00.788094 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 43/89] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:00.792316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa32989-c0cb-4fb2-b4f0-f78ff85a3882 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.795000 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b500-7e52-4afc-b340-37697401fae9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.797502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2ae18-bf68-4fc0-a2ca-1f6d7e09bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.798574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ae18-bf68-4fc0-a2ca-1f6d7e09bf67 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.798996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ae18-bf68-4fc0-a2ca-1f6d7e09bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.799433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ae18-bf68-4fc0-a2ca-1f6d7e09bf67 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.800963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2ae18-bf68-4fc0-a2ca-1f6d7e09bf67 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.803344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2ae18-bf68-4fc0-a2ca-1f6d7e09bf67 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.805730 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 47/90] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.808214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b500-7e52-4afc-b340-37697401fae9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.812258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2ae18-bf68-4fc0-a2ca-1f6d7e09bf67 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.822136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.822830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.823115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.823391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.824172 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:00.824532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.826186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.830432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2ae18-bf68-4fc0-a2ca-1f6d7e09bf67 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.837191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.843653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 44/91] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:00.843905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.843905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.843905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.843905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] RBAC: Adding query filter params (role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user.id=beb11f34c6cf46fe9a631e0e48e77875) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:00.843905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.844217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.846133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.852195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 48/92] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/role_assignments?user.id=beb11f34c6cf46fe9a631e0e48e77875&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.858347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf520b-088c-44f0-94ae-d8bebe4b0542 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.862830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da1901-9420-460e-945e-4ccb40e3e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.863863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da1901-9420-460e-945e-4ccb40e3e39c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.864150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da1901-9420-460e-945e-4ccb40e3e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.864429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da1901-9420-460e-945e-4ccb40e3e39c admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.865827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da1901-9420-460e-945e-4ccb40e3e39c admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.868262 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da1901-9420-460e-945e-4ccb40e3e39c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.870073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 45/93] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:00.876718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.890562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799e927-99a2-4d09-9b36-967ed1421110 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.898503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4fcfa-e0e3-4e23-b3b8-f9f6d523f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.899223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4fcfa-e0e3-4e23-b3b8-f9f6d523f083 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.899609 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4fcfa-e0e3-4e23-b3b8-f9f6d523f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.899918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4fcfa-e0e3-4e23-b3b8-f9f6d523f083 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.913342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4fcfa-e0e3-4e23-b3b8-f9f6d523f083 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.915953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4fcfa-e0e3-4e23-b3b8-f9f6d523f083 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.930326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 49/94] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:00.937022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da1901-9420-460e-945e-4ccb40e3e39c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.947881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da1901-9420-460e-945e-4ccb40e3e39c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.954294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfbac3-cb35-4993-9636-d6ee0c037813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.955229 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfbac3-cb35-4993-9636-d6ee0c037813 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.955511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfbac3-cb35-4993-9636-d6ee0c037813 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.955909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfbac3-cb35-4993-9636-d6ee0c037813 admin admin] PATH_INFO: `/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.957123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfbac3-cb35-4993-9636-d6ee0c037813 admin admin] RBAC: Authorizing `identity:get_project(project_id=efa4dc6cc4314e2b99265a59d8e879f7)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.959303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfbac3-cb35-4993-9636-d6ee0c037813 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.961731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 46/95] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:00.968648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4fcfa-e0e3-4e23-b3b8-f9f6d523f083 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:00.978356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4fcfa-e0e3-4e23-b3b8-f9f6d523f083 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:00.982947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc169f-1a00-455c-a693-300c1c99e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:00.983666 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc169f-1a00-455c-a693-300c1c99e1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:00.984040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc169f-1a00-455c-a693-300c1c99e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:00.984370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc169f-1a00-455c-a693-300c1c99e1a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:00.985214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc169f-1a00-455c-a693-300c1c99e1a4 admin admin] RBAC: Adding query filter params (role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=efa4dc6cc4314e2b99265a59d8e879f7, user.id=beb11f34c6cf46fe9a631e0e48e77875) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:00.985579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc169f-1a00-455c-a693-300c1c99e1a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:00.987519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc169f-1a00-455c-a693-300c1c99e1a4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:00.995012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 50/96] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:00 2021] GET /identity/v3/role_assignments?user.id=beb11f34c6cf46fe9a631e0e48e77875&scope.project.id=efa4dc6cc4314e2b99265a59d8e879f7&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.129772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b94e6-0663-479b-9b12-d05730868386 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.130590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b94e6-0663-479b-9b12-d05730868386 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.131062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b94e6-0663-479b-9b12-d05730868386 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.133362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 47/97] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:03.139734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077168ca-e461-449b-916c-1b3810d758b5 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.140605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077168ca-e461-449b-916c-1b3810d758b5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.141112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077168ca-e461-449b-916c-1b3810d758b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.168710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-077168ca-e461-449b-916c-1b3810d758b5 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:03.170203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-077168ca-e461-449b-916c-1b3810d758b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:03.182441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 51/98] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:03.206028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b94e6-0663-479b-9b12-d05730868386 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.221302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b94e6-0663-479b-9b12-d05730868386 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.226568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a175-a739-4e60-958e-b321d0a21f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.227596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a175-a739-4e60-958e-b321d0a21f85 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.228122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a175-a739-4e60-958e-b321d0a21f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.228596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a175-a739-4e60-958e-b321d0a21f85 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.244615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0a175-a739-4e60-958e-b321d0a21f85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:03.251579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-f3c0a175-a739-4e60-958e-b321d0a21f85 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:03.253002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 48/99] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:03.260155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077168ca-e461-449b-916c-1b3810d758b5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.269200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077168ca-e461-449b-916c-1b3810d758b5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.279577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.280546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.281041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.281507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.282449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:03.282960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.284850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.299164 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 52/100] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.305644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a175-a739-4e60-958e-b321d0a21f85 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.322209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a175-a739-4e60-958e-b321d0a21f85 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.331545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967c21-fa30-4f2f-9289-2db6fd747358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.332480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967c21-fa30-4f2f-9289-2db6fd747358 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.332766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967c21-fa30-4f2f-9289-2db6fd747358 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.333046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967c21-fa30-4f2f-9289-2db6fd747358 admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.340495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31967c21-fa30-4f2f-9289-2db6fd747358 admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.342759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31967c21-fa30-4f2f-9289-2db6fd747358 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.344745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 49/101] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.351310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.367838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd0ad-95ae-4801-a495-22bed15ec0e0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.375814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2d9ea-4398-41b0-a0cf-cfb58520bfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.376954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2d9ea-4398-41b0-a0cf-cfb58520bfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.377434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2d9ea-4398-41b0-a0cf-cfb58520bfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.377901 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2d9ea-4398-41b0-a0cf-cfb58520bfe5 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.384304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2d9ea-4398-41b0-a0cf-cfb58520bfe5 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.386592 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2d9ea-4398-41b0-a0cf-cfb58520bfe5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.388511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 53/102] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.394891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967c21-fa30-4f2f-9289-2db6fd747358 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.396941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2427-e9f3-4387-92d2-0f73e866c9d3 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.397234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2427-e9f3-4387-92d2-0f73e866c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.397519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2427-e9f3-4387-92d2-0f73e866c9d3 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.399346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 54/103] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:03.405496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d86abc-d205-4fad-ae9b-638dd6a217a8 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.405786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d86abc-d205-4fad-ae9b-638dd6a217a8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.406064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d86abc-d205-4fad-ae9b-638dd6a217a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.411053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967c21-fa30-4f2f-9289-2db6fd747358 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.424770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e3d86abc-d205-4fad-ae9b-638dd6a217a8 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:03.425283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91446236-ee7d-4a4c-9e95-eeab34576a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.425928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e3d86abc-d205-4fad-ae9b-638dd6a217a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:03.426196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91446236-ee7d-4a4c-9e95-eeab34576a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.426482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91446236-ee7d-4a4c-9e95-eeab34576a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.426761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91446236-ee7d-4a4c-9e95-eeab34576a45 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/users/beb11f34c6cf46fe9a631e0e48e77875/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.429074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91446236-ee7d-4a4c-9e95-eeab34576a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user_id=beb11f34c6cf46fe9a631e0e48e77875, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.431780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91446236-ee7d-4a4c-9e95-eeab34576a45 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.441145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 55/104] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:03.458982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 50/105] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:03 2021] PUT /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/users/beb11f34c6cf46fe9a631e0e48e77875/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:03.475661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d86abc-d205-4fad-ae9b-638dd6a217a8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.485344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d86abc-d205-4fad-ae9b-638dd6a217a8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.531150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eb11a-e30c-4109-9e8e-58e50e7e3c6c None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.531763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eb11a-e30c-4109-9e8e-58e50e7e3c6c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.532240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eb11a-e30c-4109-9e8e-58e50e7e3c6c None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.534269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 51/106] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:03.541509 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ff100-c207-49d4-af80-d45c962a967c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.542071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ff100-c207-49d4-af80-d45c962a967c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.542521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ff100-c207-49d4-af80-d45c962a967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.549419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ea369-4cc3-4edc-b02d-b65b5f0e032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.550238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea369-4cc3-4edc-b02d-b65b5f0e032f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.550524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea369-4cc3-4edc-b02d-b65b5f0e032f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.550800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea369-4cc3-4edc-b02d-b65b5f0e032f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.562614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ea369-4cc3-4edc-b02d-b65b5f0e032f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:03.571315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-4c8ea369-4cc3-4edc-b02d-b65b5f0e032f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:03.573544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 56/107] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:03.580911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5db3a-d5b6-4c8a-9c41-28683815eae8 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.581218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5db3a-d5b6-4c8a-9c41-28683815eae8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.581483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5db3a-d5b6-4c8a-9c41-28683815eae8 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.583360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 57/108] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:03.584099 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f01ff100-c207-49d4-af80-d45c962a967c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:03.584944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5db3a-d5b6-4c8a-9c41-28683815eae8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.585166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f01ff100-c207-49d4-af80-d45c962a967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:03.595232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 52/109] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 28 03:25:03.597082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf954b5-6062-4b3a-a71d-e50dec45ad96 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.597373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf954b5-6062-4b3a-a71d-e50dec45ad96 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.597655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf954b5-6062-4b3a-a71d-e50dec45ad96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.613158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5db3a-d5b6-4c8a-9c41-28683815eae8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.617969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-acf954b5-6062-4b3a-a71d-e50dec45ad96 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:03.619166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-acf954b5-6062-4b3a-a71d-e50dec45ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:03.622323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22618959-b5ee-4214-ad8d-85c4e872b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.623366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22618959-b5ee-4214-ad8d-85c4e872b3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.623812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22618959-b5ee-4214-ad8d-85c4e872b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.624226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22618959-b5ee-4214-ad8d-85c4e872b3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.625219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22618959-b5ee-4214-ad8d-85c4e872b3e9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:03.625774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22618959-b5ee-4214-ad8d-85c4e872b3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.627367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 53/110] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:03.628284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22618959-b5ee-4214-ad8d-85c4e872b3e9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.637648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf954b5-6062-4b3a-a71d-e50dec45ad96 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.648576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf954b5-6062-4b3a-a71d-e50dec45ad96 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.649862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 58/111] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:03.651469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8a542-a7ad-4c3c-9aac-c211e60cd1e7 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.651919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8a542-a7ad-4c3c-9aac-c211e60cd1e7 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.652319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8a542-a7ad-4c3c-9aac-c211e60cd1e7 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.654316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 59/112] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:03.655415 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa9b8-d5b6-49b7-8262-ba9ef9caf430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.656266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa9b8-d5b6-49b7-8262-ba9ef9caf430 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.656555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa9b8-d5b6-49b7-8262-ba9ef9caf430 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.656834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa9b8-d5b6-49b7-8262-ba9ef9caf430 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.663187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8a542-a7ad-4c3c-9aac-c211e60cd1e7 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.674672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aa9b8-d5b6-49b7-8262-ba9ef9caf430 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:03.677705 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8a542-a7ad-4c3c-9aac-c211e60cd1e7 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.681827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d19aa9b8-d5b6-49b7-8262-ba9ef9caf430 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:03.682060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b7ced-cc49-4f95-bd54-cfe03a118d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.682875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b7ced-cc49-4f95-bd54-cfe03a118d16 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.683079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 54/113] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:03.684509 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32ae6b-edee-4fdb-bd39-2829d07249d6 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.684864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32ae6b-edee-4fdb-bd39-2829d07249d6 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.685076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32ae6b-edee-4fdb-bd39-2829d07249d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.687815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b7ced-cc49-4f95-bd54-cfe03a118d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.688496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b7ced-cc49-4f95-bd54-cfe03a118d16 admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.689803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b7ced-cc49-4f95-bd54-cfe03a118d16 admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.692044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b7ced-cc49-4f95-bd54-cfe03a118d16 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.693981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 60/114] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.694452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b7ced-cc49-4f95-bd54-cfe03a118d16 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.707654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b7ced-cc49-4f95-bd54-cfe03a118d16 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.707883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5f32ae6b-edee-4fdb-bd39-2829d07249d6 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:03.709543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5f32ae6b-edee-4fdb-bd39-2829d07249d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:03.712660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a4e65-4f47-432a-821a-fb422242e213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.713715 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4e65-4f47-432a-821a-fb422242e213 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.713997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4e65-4f47-432a-821a-fb422242e213 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.714451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4e65-4f47-432a-821a-fb422242e213 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.721216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 55/115] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:03.721907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32ae6b-edee-4fdb-bd39-2829d07249d6 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.730745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a4e65-4f47-432a-821a-fb422242e213 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:03.738167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-c33a4e65-4f47-432a-821a-fb422242e213 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:03.739576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 61/116] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:03.740196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a4e65-4f47-432a-821a-fb422242e213 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.742643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32ae6b-edee-4fdb-bd39-2829d07249d6 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.750004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a4e65-4f47-432a-821a-fb422242e213 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.751625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.752393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.752676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.752950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.753694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:03.754001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.755616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.760717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386e67-28cd-43c7-976e-3553a3e27aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.761570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386e67-28cd-43c7-976e-3553a3e27aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.761849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386e67-28cd-43c7-976e-3553a3e27aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.762122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386e67-28cd-43c7-976e-3553a3e27aa0 admin admin] PATH_INFO: `/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.763305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386e67-28cd-43c7-976e-3553a3e27aa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=efa4dc6cc4314e2b99265a59d8e879f7)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.764546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 56/117] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.765225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.765409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386e67-28cd-43c7-976e-3553a3e27aa0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.767147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 62/118] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.773692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386e67-28cd-43c7-976e-3553a3e27aa0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.777531 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f7b5-c2ad-477c-9169-eb5345696c9f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.781817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.782422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386e67-28cd-43c7-976e-3553a3e27aa0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.782541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.782813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.783090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.783924 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:03.784234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.786023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.786748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec04a-e5bb-4be2-b825-4f0620df5d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.787518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec04a-e5bb-4be2-b825-4f0620df5d7e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.787822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec04a-e5bb-4be2-b825-4f0620df5d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.788100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec04a-e5bb-4be2-b825-4f0620df5d7e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.790119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fec04a-e5bb-4be2-b825-4f0620df5d7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.791806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fec04a-e5bb-4be2-b825-4f0620df5d7e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.793344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 63/119] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.794095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec04a-e5bb-4be2-b825-4f0620df5d7e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.796410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 57/120] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.797425 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.807961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec04a-e5bb-4be2-b825-4f0620df5d7e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.808266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f2808-ddd5-4428-ae87-c1e271b4e9ed admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.812041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1e8de-5999-497e-990b-51c113fb59d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.812291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c882b-ce84-42f5-9707-1e46ddc4cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.812900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e8de-5999-497e-990b-51c113fb59d5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.813129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c882b-ce84-42f5-9707-1e46ddc4cb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.813228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e8de-5999-497e-990b-51c113fb59d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.813417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c882b-ce84-42f5-9707-1e46ddc4cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.813523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e8de-5999-497e-990b-51c113fb59d5 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.813688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c882b-ce84-42f5-9707-1e46ddc4cb25 admin admin] PATH_INFO: `/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7/users/beb11f34c6cf46fe9a631e0e48e77875/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.814551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1e8de-5999-497e-990b-51c113fb59d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.815494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c882b-ce84-42f5-9707-1e46ddc4cb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa4dc6cc4314e2b99265a59d8e879f7, user_id=beb11f34c6cf46fe9a631e0e48e77875, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.816389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1e8de-5999-497e-990b-51c113fb59d5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.818103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 64/121] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.818206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c882b-ce84-42f5-9707-1e46ddc4cb25 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.823886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1e8de-5999-497e-990b-51c113fb59d5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.832775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 58/122] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:03 2021] PUT /identity/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7/users/beb11f34c6cf46fe9a631e0e48e77875/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:03.833395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c882b-ce84-42f5-9707-1e46ddc4cb25 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.833989 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1e8de-5999-497e-990b-51c113fb59d5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.906735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c882b-ce84-42f5-9707-1e46ddc4cb25 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.917287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3037-49dd-4b69-97bf-718ac5512bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.918189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3037-49dd-4b69-97bf-718ac5512bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.918474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3037-49dd-4b69-97bf-718ac5512bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.918750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3037-49dd-4b69-97bf-718ac5512bd2 admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.920605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3037-49dd-4b69-97bf-718ac5512bd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.922852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3037-49dd-4b69-97bf-718ac5512bd2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.924768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 59/123] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.925404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3037-49dd-4b69-97bf-718ac5512bd2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.930896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.932526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.932814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.933091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.933825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.934868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:03.934868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:03.934868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:03.936214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.939734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3037-49dd-4b69-97bf-718ac5512bd2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.944900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe769-bddf-495f-9ac1-de0e5269c253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.946367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe769-bddf-495f-9ac1-de0e5269c253 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.946837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe769-bddf-495f-9ac1-de0e5269c253 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.947295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe769-bddf-495f-9ac1-de0e5269c253 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.949235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fe769-bddf-495f-9ac1-de0e5269c253 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.952048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fe769-bddf-495f-9ac1-de0e5269c253 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.954742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 60/124] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.955896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe769-bddf-495f-9ac1-de0e5269c253 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.968996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe769-bddf-495f-9ac1-de0e5269c253 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:03.971143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 65/125] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:25:03 2021] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:03.980009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:03.988244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968bf10-10d5-46f6-85de-8a03a3d08a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:03.989136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968bf10-10d5-46f6-85de-8a03a3d08a31 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:03.989408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968bf10-10d5-46f6-85de-8a03a3d08a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:03.989686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968bf10-10d5-46f6-85de-8a03a3d08a31 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:03.991563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968bf10-10d5-46f6-85de-8a03a3d08a31 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:03.994023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968bf10-10d5-46f6-85de-8a03a3d08a31 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:03.995879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 61/126] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:03 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:03.999341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23609-ab4b-44b0-8be2-bfd951e3796e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:04.002643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968bf10-10d5-46f6-85de-8a03a3d08a31 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:04.005789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7dc60-df01-41c2-808e-f29eb2f3c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:04.006728 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7dc60-df01-41c2-808e-f29eb2f3c4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:04.007539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7dc60-df01-41c2-808e-f29eb2f3c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:04.007868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7dc60-df01-41c2-808e-f29eb2f3c4b5 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/users/398ba2372d694a5b8498f1f6df8ec46d/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:04.011814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7dc60-df01-41c2-808e-f29eb2f3c4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user_id=398ba2372d694a5b8498f1f6df8ec46d, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:04.012911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-c6b7dc60-df01-41c2-808e-f29eb2f3c4b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:04.012911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:04.012911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:04.015238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7dc60-df01-41c2-808e-f29eb2f3c4b5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:04.015850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968bf10-10d5-46f6-85de-8a03a3d08a31 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:04.021856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fbba9-87a5-40d4-93b3-18dc5b15f21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:04.023204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fbba9-87a5-40d4-93b3-18dc5b15f21d admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:04.025717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fbba9-87a5-40d4-93b3-18dc5b15f21d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:04.026251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fbba9-87a5-40d4-93b3-18dc5b15f21d admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/users/beb11f34c6cf46fe9a631e0e48e77875/roles/86c69e4b7605423ebcc1c4d6bc21c052` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:04.029025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fbba9-87a5-40d4-93b3-18dc5b15f21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user_id=beb11f34c6cf46fe9a631e0e48e77875, role_id=86c69e4b7605423ebcc1c4d6bc21c052)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:04.032130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fbba9-87a5-40d4-93b3-18dc5b15f21d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:04.035768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 66/127] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:03 2021] PUT /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/users/398ba2372d694a5b8498f1f6df8ec46d/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:04.056686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 62/128] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:04 2021] PUT /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/users/beb11f34c6cf46fe9a631e0e48e77875/roles/86c69e4b7605423ebcc1c4d6bc21c052 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:06.472601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450f4b2-a8a6-4e13-a967-1c0038de3475 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:06.473079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450f4b2-a8a6-4e13-a967-1c0038de3475 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:06.473079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450f4b2-a8a6-4e13-a967-1c0038de3475 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:06.474961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 67/129] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:06.493824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f15c-3771-4fb5-9ad1-3678c81b80bb None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:06.494401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f15c-3771-4fb5-9ad1-3678c81b80bb None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:06.494401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f15c-3771-4fb5-9ad1-3678c81b80bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:06.517645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b999f15c-3771-4fb5-9ad1-3678c81b80bb None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:06.518789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b999f15c-3771-4fb5-9ad1-3678c81b80bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:06.593460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 63/130] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:06.633508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450f4b2-a8a6-4e13-a967-1c0038de3475 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:06.649871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450f4b2-a8a6-4e13-a967-1c0038de3475 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:06.654125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca33a4-93f6-47d1-9954-5ad936f70248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:06.654917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca33a4-93f6-47d1-9954-5ad936f70248 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:06.655196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca33a4-93f6-47d1-9954-5ad936f70248 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:06.655474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca33a4-93f6-47d1-9954-5ad936f70248 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:06.670621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca33a4-93f6-47d1-9954-5ad936f70248 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:06.677397 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-d8ca33a4-93f6-47d1-9954-5ad936f70248 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:06.678619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 68/131] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:06.685812 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f15c-3771-4fb5-9ad1-3678c81b80bb None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:06.694347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f15c-3771-4fb5-9ad1-3678c81b80bb None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:06.703609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:06.704362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:06.704648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:06.704921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:06.705678 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:06.705979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:06.707595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:06.718419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 64/132] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:06.724589 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca33a4-93f6-47d1-9954-5ad936f70248 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:06.734848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca33a4-93f6-47d1-9954-5ad936f70248 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:06.744474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae7d9c-43cc-470a-83ea-038a2b42e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:06.745353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae7d9c-43cc-470a-83ea-038a2b42e7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:06.745636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae7d9c-43cc-470a-83ea-038a2b42e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:06.745910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae7d9c-43cc-470a-83ea-038a2b42e7f3 admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:06.747065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae7d9c-43cc-470a-83ea-038a2b42e7f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:06.749270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae7d9c-43cc-470a-83ea-038a2b42e7f3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:06.750837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 69/133] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:06 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:06.757462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:06.766828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504ac2-efe4-4fa6-9847-0ca8823af593 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:06.776553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e45ca-81b4-4aad-9f18-cc3aeb4c6664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:06.777215 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e45ca-81b4-4aad-9f18-cc3aeb4c6664 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:06.777498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e45ca-81b4-4aad-9f18-cc3aeb4c6664 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:06.777777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e45ca-81b4-4aad-9f18-cc3aeb4c6664 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:06.790438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e45ca-81b4-4aad-9f18-cc3aeb4c6664 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:06.792259 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e45ca-81b4-4aad-9f18-cc3aeb4c6664 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:06.800947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 65/134] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:06.807437 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae7d9c-43cc-470a-83ea-038a2b42e7f3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:06.816690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae7d9c-43cc-470a-83ea-038a2b42e7f3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:06.823951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d84ba9-79db-4d5e-80a3-c2dde8f8f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:06.824818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d84ba9-79db-4d5e-80a3-c2dde8f8f877 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:06.825094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d84ba9-79db-4d5e-80a3-c2dde8f8f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:06.825365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d84ba9-79db-4d5e-80a3-c2dde8f8f877 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:06.826527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d84ba9-79db-4d5e-80a3-c2dde8f8f877 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:06.828700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d84ba9-79db-4d5e-80a3-c2dde8f8f877 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:06.830349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 70/135] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:06 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:06.837336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e45ca-81b4-4aad-9f18-cc3aeb4c6664 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:06.846015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e45ca-81b4-4aad-9f18-cc3aeb4c6664 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:06.855635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c89a9-7bda-4e44-81ac-6db41f3a4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:06.856314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c89a9-7bda-4e44-81ac-6db41f3a4983 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:06.856599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c89a9-7bda-4e44-81ac-6db41f3a4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:06.856878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c89a9-7bda-4e44-81ac-6db41f3a4983 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:06.857708 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c89a9-7bda-4e44-81ac-6db41f3a4983 admin admin] RBAC: Adding query filter params (role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user.id=beb11f34c6cf46fe9a631e0e48e77875) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:06.858016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c89a9-7bda-4e44-81ac-6db41f3a4983 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:06.859903 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c89a9-7bda-4e44-81ac-6db41f3a4983 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:06.866075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 66/136] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:06 2021] GET /identity/v3/role_assignments?user.id=beb11f34c6cf46fe9a631e0e48e77875&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:07.434594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b5df0-f16d-4e45-aa4c-f953d6748cb5 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.434926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b5df0-f16d-4e45-aa4c-f953d6748cb5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.435118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b5df0-f16d-4e45-aa4c-f953d6748cb5 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.436870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 71/137] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:07.442936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36e213-0302-4268-b2b2-98f634b9086f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.443225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36e213-0302-4268-b2b2-98f634b9086f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.443501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36e213-0302-4268-b2b2-98f634b9086f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.465749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5f36e213-0302-4268-b2b2-98f634b9086f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:07.466882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5f36e213-0302-4268-b2b2-98f634b9086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:07.478989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 67/138] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:07.516220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b5df0-f16d-4e45-aa4c-f953d6748cb5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:07.533313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b5df0-f16d-4e45-aa4c-f953d6748cb5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:07.537535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c1b2-9cdb-4b42-95e9-fe24e9a86f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:07.538378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c1b2-9cdb-4b42-95e9-fe24e9a86f30 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.538907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c1b2-9cdb-4b42-95e9-fe24e9a86f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.539290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c1b2-9cdb-4b42-95e9-fe24e9a86f30 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.552252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5c1b2-9cdb-4b42-95e9-fe24e9a86f30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:07.559982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-75d5c1b2-9cdb-4b42-95e9-fe24e9a86f30 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:07.561209 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 72/139] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:07.567638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36e213-0302-4268-b2b2-98f634b9086f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:07.577114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36e213-0302-4268-b2b2-98f634b9086f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:07.583577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:07.584296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.584587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.584865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.585671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:07.585985 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:07.587608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:07.605895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 68/140] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:07.612419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c1b2-9cdb-4b42-95e9-fe24e9a86f30 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:07.622688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c1b2-9cdb-4b42-95e9-fe24e9a86f30 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:07.631650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6424885-2980-4ac2-aec6-10e36682bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:07.633416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424885-2980-4ac2-aec6-10e36682bee8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.633702 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424885-2980-4ac2-aec6-10e36682bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.633982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424885-2980-4ac2-aec6-10e36682bee8 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.640493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6424885-2980-4ac2-aec6-10e36682bee8 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:07.642362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6424885-2980-4ac2-aec6-10e36682bee8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:07.644013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 73/141] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:07 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:07.650636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:07.665360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbd525-0c88-401c-a344-425776e0c784 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:07.669655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7092ab5-f987-4edc-9fbc-3c0b04bd67e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:07.670327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092ab5-f987-4edc-9fbc-3c0b04bd67e1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.670616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092ab5-f987-4edc-9fbc-3c0b04bd67e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.670899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092ab5-f987-4edc-9fbc-3c0b04bd67e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.689079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7092ab5-f987-4edc-9fbc-3c0b04bd67e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:07.690805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7092ab5-f987-4edc-9fbc-3c0b04bd67e1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:07.703625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 69/142] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:07.710027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6424885-2980-4ac2-aec6-10e36682bee8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:07.725388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6424885-2980-4ac2-aec6-10e36682bee8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:07.735742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd4494-22a6-419e-bf1b-8e1dfa288ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:07.736692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd4494-22a6-419e-bf1b-8e1dfa288ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.736972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd4494-22a6-419e-bf1b-8e1dfa288ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.737247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd4494-22a6-419e-bf1b-8e1dfa288ba1 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.744645 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd4494-22a6-419e-bf1b-8e1dfa288ba1 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:07.746769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd4494-22a6-419e-bf1b-8e1dfa288ba1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:07.748539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 74/143] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:07 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:07.755234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7092ab5-f987-4edc-9fbc-3c0b04bd67e1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:07.768706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7092ab5-f987-4edc-9fbc-3c0b04bd67e1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:07.773024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad1f4-6616-4aa3-9ef5-7d72682ec12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:07.773690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad1f4-6616-4aa3-9ef5-7d72682ec12e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.773977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad1f4-6616-4aa3-9ef5-7d72682ec12e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.774258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad1f4-6616-4aa3-9ef5-7d72682ec12e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.775093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad1f4-6616-4aa3-9ef5-7d72682ec12e admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user.id=398ba2372d694a5b8498f1f6df8ec46d) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:07.775408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad1f4-6616-4aa3-9ef5-7d72682ec12e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:07.777315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad1f4-6616-4aa3-9ef5-7d72682ec12e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:07.792301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 70/144] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:07 2021] GET /identity/v3/role_assignments?user.id=398ba2372d694a5b8498f1f6df8ec46d&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:07.912694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25efee-23ba-48b0-b007-89dc373f6e75 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.913047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25efee-23ba-48b0-b007-89dc373f6e75 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.913784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25efee-23ba-48b0-b007-89dc373f6e75 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.916150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 75/145] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:07.922823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374df6-6721-421d-b480-687e6bade197 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.923112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374df6-6721-421d-b480-687e6bade197 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.923391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374df6-6721-421d-b480-687e6bade197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.945726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-64374df6-6721-421d-b480-687e6bade197 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:07.946820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-64374df6-6721-421d-b480-687e6bade197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:07.958044 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 71/146] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:07.973412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06dbf9-69cd-4491-ad51-951d76e068f6 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.973729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06dbf9-69cd-4491-ad51-951d76e068f6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.973968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06dbf9-69cd-4491-ad51-951d76e068f6 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:07.976377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 76/147] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:07.982944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf17df-a613-479c-a9fe-a99df38d4d25 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:07.983234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf17df-a613-479c-a9fe-a99df38d4d25 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:07.983513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf17df-a613-479c-a9fe-a99df38d4d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.006484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06dbf9-69cd-4491-ad51-951d76e068f6 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.018036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1acf17df-a613-479c-a9fe-a99df38d4d25 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:08.019201 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1acf17df-a613-479c-a9fe-a99df38d4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:08.022373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06dbf9-69cd-4491-ad51-951d76e068f6 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.034947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f036f8-7936-4c34-b3b6-81db096dd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.035795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f036f8-7936-4c34-b3b6-81db096dd451 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.036079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f036f8-7936-4c34-b3b6-81db096dd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.036350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f036f8-7936-4c34-b3b6-81db096dd451 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.038041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 72/148] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:08.053451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f036f8-7936-4c34-b3b6-81db096dd451 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:08.061639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-d3f036f8-7936-4c34-b3b6-81db096dd451 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:08.062890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 77/149] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:08.070132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf17df-a613-479c-a9fe-a99df38d4d25 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.079940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf17df-a613-479c-a9fe-a99df38d4d25 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.081481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f036f8-7936-4c34-b3b6-81db096dd451 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.093370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.094063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.094342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.094615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.095379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:08.095684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.097353 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.101873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f036f8-7936-4c34-b3b6-81db096dd451 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.111612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 73/150] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.118325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba7ad-9f3f-4812-90f7-718ae9de825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.119142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba7ad-9f3f-4812-90f7-718ae9de825a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.119424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba7ad-9f3f-4812-90f7-718ae9de825a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.119698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba7ad-9f3f-4812-90f7-718ae9de825a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.120716 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.143151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31509b-4d54-4cd5-80a4-799c51efe9f6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.149593 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ba7ad-9f3f-4812-90f7-718ae9de825a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:08.163242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa37e-b3d3-404d-9564-42534b5bbeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.164960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa37e-b3d3-404d-9564-42534b5bbeab admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.165235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa37e-b3d3-404d-9564-42534b5bbeab admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.165513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa37e-b3d3-404d-9564-42534b5bbeab admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.166798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-0c4ba7ad-9f3f-4812-90f7-718ae9de825a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:08.168092 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 78/151] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:08.168829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaa37e-b3d3-404d-9564-42534b5bbeab admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.171078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaa37e-b3d3-404d-9564-42534b5bbeab admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.173116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 74/152] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.179371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba7ad-9f3f-4812-90f7-718ae9de825a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.180905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa37e-b3d3-404d-9564-42534b5bbeab admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.203153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba7ad-9f3f-4812-90f7-718ae9de825a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.203838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa37e-b3d3-404d-9564-42534b5bbeab admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.215844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.216885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.217388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.217862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.218815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:08.219320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.220390 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb6e9f-7b4d-4f1c-8341-e5c499998a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.221054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb6e9f-7b4d-4f1c-8341-e5c499998a14 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.221334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb6e9f-7b4d-4f1c-8341-e5c499998a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.221610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb6e9f-7b4d-4f1c-8341-e5c499998a14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.222064 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.230792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb6e9f-7b4d-4f1c-8341-e5c499998a14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.232348 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 75/153] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.233719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb6e9f-7b4d-4f1c-8341-e5c499998a14 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.238616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.253765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849343-24ff-449c-a663-df9e93d29185 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.254385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 79/154] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:08.258541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb6e9f-7b4d-4f1c-8341-e5c499998a14 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.268656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbf479-f300-4b1e-8893-dd53fb44f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.269868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf479-f300-4b1e-8893-dd53fb44f86e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.270353 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf479-f300-4b1e-8893-dd53fb44f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.270860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf479-f300-4b1e-8893-dd53fb44f86e admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.273856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbf479-f300-4b1e-8893-dd53fb44f86e admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.276268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbf479-f300-4b1e-8893-dd53fb44f86e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.277334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb6e9f-7b4d-4f1c-8341-e5c499998a14 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.279749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 76/155] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:08.282058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37917-b105-4b89-8e44-1148a9603d66 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.282856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37917-b105-4b89-8e44-1148a9603d66 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.283775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37917-b105-4b89-8e44-1148a9603d66 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.286505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 77/156] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:08.288858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a37917-b105-4b89-8e44-1148a9603d66 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.289640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd8232-3b58-48d7-9318-bb14a5e15d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.290713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8232-3b58-48d7-9318-bb14a5e15d30 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.291199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8232-3b58-48d7-9318-bb14a5e15d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.291787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8232-3b58-48d7-9318-bb14a5e15d30 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.293411 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd8232-3b58-48d7-9318-bb14a5e15d30 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.295743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd8232-3b58-48d7-9318-bb14a5e15d30 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.298787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 80/157] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.300994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfb6-fc61-4e78-8b5c-1974b69c513b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.301800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfb6-fc61-4e78-8b5c-1974b69c513b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.302700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfb6-fc61-4e78-8b5c-1974b69c513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.316969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a37917-b105-4b89-8e44-1148a9603d66 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.329570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d367d-4229-4c42-b7e3-12bb133b076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.330522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d367d-4229-4c42-b7e3-12bb133b076e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.331003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d367d-4229-4c42-b7e3-12bb133b076e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.331477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d367d-4229-4c42-b7e3-12bb133b076e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.342532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1725cfb6-fc61-4e78-8b5c-1974b69c513b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:08.344832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d367d-4229-4c42-b7e3-12bb133b076e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.346358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1725cfb6-fc61-4e78-8b5c-1974b69c513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:08.347046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d367d-4229-4c42-b7e3-12bb133b076e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.356384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 78/158] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:08.357470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d367d-4229-4c42-b7e3-12bb133b076e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.359904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 81/159] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:08.371464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d367d-4229-4c42-b7e3-12bb133b076e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.373749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725cfb6-fc61-4e78-8b5c-1974b69c513b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.376155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.376925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.377308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.377681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.378617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] RBAC: Adding query filter params (role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b, user.id=beb11f34c6cf46fe9a631e0e48e77875) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:08.379027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.383739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.387462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 79/160] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/role_assignments?user.id=beb11f34c6cf46fe9a631e0e48e77875&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.389125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725cfb6-fc61-4e78-8b5c-1974b69c513b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.398631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa667092-277d-44c4-9b63-36697da3cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.399897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa667092-277d-44c4-9b63-36697da3cccc admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.400347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa667092-277d-44c4-9b63-36697da3cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.400785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa667092-277d-44c4-9b63-36697da3cccc admin admin] PATH_INFO: `/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.402252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa667092-277d-44c4-9b63-36697da3cccc admin admin] RBAC: Authorizing `identity:get_project(project_id=efa4dc6cc4314e2b99265a59d8e879f7)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.403060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.404894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa667092-277d-44c4-9b63-36697da3cccc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.407357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 82/161] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.414706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08686-4128-4689-a3fa-a3efb4fec313 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.422457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa667092-277d-44c4-9b63-36697da3cccc admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.437506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a6e06-3275-4458-9d75-28e43d05695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.438218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa667092-277d-44c4-9b63-36697da3cccc admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.438350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6e06-3275-4458-9d75-28e43d05695e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.438808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6e06-3275-4458-9d75-28e43d05695e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.439228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6e06-3275-4458-9d75-28e43d05695e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.443397 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.444698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.445185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.445661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.446703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] RBAC: Adding query filter params (role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=efa4dc6cc4314e2b99265a59d8e879f7, user.id=beb11f34c6cf46fe9a631e0e48e77875) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:08.447313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.453911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.463136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a6e06-3275-4458-9d75-28e43d05695e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:08.465878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 83/162] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/role_assignments?user.id=beb11f34c6cf46fe9a631e0e48e77875&scope.project.id=efa4dc6cc4314e2b99265a59d8e879f7&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:08.477735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-aa6a6e06-3275-4458-9d75-28e43d05695e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:08.479021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 80/163] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:08.485892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.500744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d41fdb-edd8-4be9-9319-32946d8f3acb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.510043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.511101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.511605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.512111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.513087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] RBAC: Adding query filter params (name=member) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:08.513618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.515578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.529355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 84/164] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.535621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a6e06-3275-4458-9d75-28e43d05695e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.552624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a6e06-3275-4458-9d75-28e43d05695e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.559033 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8873e-03d8-42e4-a6bc-0eb542197b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.559992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8873e-03d8-42e4-a6bc-0eb542197b4b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.560326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8873e-03d8-42e4-a6bc-0eb542197b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.560605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8873e-03d8-42e4-a6bc-0eb542197b4b admin admin] PATH_INFO: `/v3/users/33a0b74416ef4bec9cc68a2c97e65985` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.588922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8873e-03d8-42e4-a6bc-0eb542197b4b admin admin] RBAC: Authorizing `identity:get_user(user_id=33a0b74416ef4bec9cc68a2c97e65985)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.591115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8873e-03d8-42e4-a6bc-0eb542197b4b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.593069 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 81/165] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/users/33a0b74416ef4bec9cc68a2c97e65985 => generated 283 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.599302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.613020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06df58-88d6-4c22-ab2b-3069094b5b5f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.618049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ee90-e702-4ff7-bbb6-e300a8aecff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.619056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ee90-e702-4ff7-bbb6-e300a8aecff5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.619541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ee90-e702-4ff7-bbb6-e300a8aecff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.620090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ee90-e702-4ff7-bbb6-e300a8aecff5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.636640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ee90-e702-4ff7-bbb6-e300a8aecff5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.638870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ee90-e702-4ff7-bbb6-e300a8aecff5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.651403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 85/166] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:08.658048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8873e-03d8-42e4-a6bc-0eb542197b4b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.673076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8873e-03d8-42e4-a6bc-0eb542197b4b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.684033 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efe00e-c3fe-431a-aaba-b01140ac64ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.685003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe00e-c3fe-431a-aaba-b01140ac64ea admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.685285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe00e-c3fe-431a-aaba-b01140ac64ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.685559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe00e-c3fe-431a-aaba-b01140ac64ea admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.687932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efe00e-c3fe-431a-aaba-b01140ac64ea admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.690079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efe00e-c3fe-431a-aaba-b01140ac64ea admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.692104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 82/167] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:08.699427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ee90-e702-4ff7-bbb6-e300a8aecff5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:08.713087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ee90-e702-4ff7-bbb6-e300a8aecff5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:08.718022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3987b-6ec7-46d2-919f-5faa7c217119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:08.718967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3987b-6ec7-46d2-919f-5faa7c217119 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:08.719484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3987b-6ec7-46d2-919f-5faa7c217119 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:08.719995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3987b-6ec7-46d2-919f-5faa7c217119 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:08.721038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3987b-6ec7-46d2-919f-5faa7c217119 admin admin] RBAC: Adding query filter params (role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=3c6f764cee714a30baaf63707c28b80f, user.id=33a0b74416ef4bec9cc68a2c97e65985) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:08.721574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3987b-6ec7-46d2-919f-5faa7c217119 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:08.727736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3987b-6ec7-46d2-919f-5faa7c217119 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:08.740487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:08 2021] GET /identity/v3/role_assignments?user.id=33a0b74416ef4bec9cc68a2c97e65985&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:09.007894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d2a6-99d6-4bd6-a01c-ce01e74dd776 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.008667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d2a6-99d6-4bd6-a01c-ce01e74dd776 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.009197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d2a6-99d6-4bd6-a01c-ce01e74dd776 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.011193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 83/169] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:09.017258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3dca-1745-4649-94a7-d672ef1278a8 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.017820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3dca-1745-4649-94a7-d672ef1278a8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.018296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3dca-1745-4649-94a7-d672ef1278a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.040551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9dda3dca-1745-4649-94a7-d672ef1278a8 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:09.042037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9dda3dca-1745-4649-94a7-d672ef1278a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:09.051803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 87/170] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:09.083213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d2a6-99d6-4bd6-a01c-ce01e74dd776 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.097718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d2a6-99d6-4bd6-a01c-ce01e74dd776 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.104035 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdef3-0579-4611-b44d-e9a8990dc843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.105092 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdef3-0579-4611-b44d-e9a8990dc843 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.105598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdef3-0579-4611-b44d-e9a8990dc843 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.106082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdef3-0579-4611-b44d-e9a8990dc843 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.120209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bdef3-0579-4611-b44d-e9a8990dc843 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:09.127315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-2d5bdef3-0579-4611-b44d-e9a8990dc843 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:09.128890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 84/171] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:09.135279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3dca-1745-4649-94a7-d672ef1278a8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.144036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3dca-1745-4649-94a7-d672ef1278a8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.148829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.149513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.149795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.150175 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.150935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:09.151243 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.152890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.165875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 88/172] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:09.174738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdef3-0579-4611-b44d-e9a8990dc843 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.188794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdef3-0579-4611-b44d-e9a8990dc843 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.195226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013f328-50f6-4d95-9e73-fd547f248f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.196164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f328-50f6-4d95-9e73-fd547f248f2d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.196448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f328-50f6-4d95-9e73-fd547f248f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.196721 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013f328-50f6-4d95-9e73-fd547f248f2d admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.197930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013f328-50f6-4d95-9e73-fd547f248f2d admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.199837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013f328-50f6-4d95-9e73-fd547f248f2d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.201696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 85/173] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:09.208134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.221766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9edc2-af78-45f3-b8e7-925f93eeb2af admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.227019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b5e0-fe77-497d-a135-babd3549f61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.227803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b5e0-fe77-497d-a135-babd3549f61f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.228093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b5e0-fe77-497d-a135-babd3549f61f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.228373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b5e0-fe77-497d-a135-babd3549f61f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.242407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b5e0-fe77-497d-a135-babd3549f61f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.244248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b5e0-fe77-497d-a135-babd3549f61f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.254519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 89/174] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:09.260425 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719623fd-75c2-461f-9ab4-b7c3432521a1 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.260656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719623fd-75c2-461f-9ab4-b7c3432521a1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.260998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719623fd-75c2-461f-9ab4-b7c3432521a1 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.262381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b5e0-fe77-497d-a135-babd3549f61f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.262838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 86/175] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:09.268389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f363544-ac6e-4589-8b45-59ce26e64aa1 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.268679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f363544-ac6e-4589-8b45-59ce26e64aa1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.268950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f363544-ac6e-4589-8b45-59ce26e64aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.270865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b5e0-fe77-497d-a135-babd3549f61f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.275296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd5fe0-235b-4330-b5fd-3d1249555aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.276373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd5fe0-235b-4330-b5fd-3d1249555aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.277483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd5fe0-235b-4330-b5fd-3d1249555aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.277763 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd5fe0-235b-4330-b5fd-3d1249555aa2 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.278914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd5fe0-235b-4330-b5fd-3d1249555aa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.281020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd5fe0-235b-4330-b5fd-3d1249555aa2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.283309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 90/176] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:09.287109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5f363544-ac6e-4589-8b45-59ce26e64aa1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:09.288852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5f363544-ac6e-4589-8b45-59ce26e64aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:09.290729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd5fe0-235b-4330-b5fd-3d1249555aa2 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.296913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 87/177] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:09.300671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd5fe0-235b-4330-b5fd-3d1249555aa2 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.305442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.306138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.306467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.306744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.307626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=3c6f764cee714a30baaf63707c28b80f, user.id=398ba2372d694a5b8498f1f6df8ec46d) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:09.307982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.309964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.315989 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 91/178] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/role_assignments?user.id=398ba2372d694a5b8498f1f6df8ec46d&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:09.322151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f363544-ac6e-4589-8b45-59ce26e64aa1 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.336140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f363544-ac6e-4589-8b45-59ce26e64aa1 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.341119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7d993-4b15-429a-a1b3-3860f183ef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.341960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d993-4b15-429a-a1b3-3860f183ef22 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.342339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d993-4b15-429a-a1b3-3860f183ef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.342616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d993-4b15-429a-a1b3-3860f183ef22 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.356122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7d993-4b15-429a-a1b3-3860f183ef22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:09.363674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-3bf7d993-4b15-429a-a1b3-3860f183ef22 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:09.365059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 88/179] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:09.372929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.382889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eaccc-ae7a-429a-8f66-d325d6e95306 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.387436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.388157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.388487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.388767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.389531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:09.389891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.391751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.401545 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 92/180] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:09.408000 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7d993-4b15-429a-a1b3-3860f183ef22 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.418689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7d993-4b15-429a-a1b3-3860f183ef22 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.423008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512f4f7-9073-4fa6-a945-5cbeb94d00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.423922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f4f7-9073-4fa6-a945-5cbeb94d00b2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.424205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f4f7-9073-4fa6-a945-5cbeb94d00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.424480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f4f7-9073-4fa6-a945-5cbeb94d00b2 admin admin] PATH_INFO: `/v3/users/33a0b74416ef4bec9cc68a2c97e65985` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.425717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512f4f7-9073-4fa6-a945-5cbeb94d00b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=33a0b74416ef4bec9cc68a2c97e65985)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.427999 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512f4f7-9073-4fa6-a945-5cbeb94d00b2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.430270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 89/181] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/users/33a0b74416ef4bec9cc68a2c97e65985 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:09.436882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.446382 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593891d-1973-4d0c-bd98-028f06e716cd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.450738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95369-f106-4538-bb1e-a191d79f85e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.451405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95369-f106-4538-bb1e-a191d79f85e0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.451686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95369-f106-4538-bb1e-a191d79f85e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.451989 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95369-f106-4538-bb1e-a191d79f85e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.461134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b95369-f106-4538-bb1e-a191d79f85e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.462976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b95369-f106-4538-bb1e-a191d79f85e0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.472914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 93/182] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:09.480034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512f4f7-9073-4fa6-a945-5cbeb94d00b2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.490459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512f4f7-9073-4fa6-a945-5cbeb94d00b2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.495126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78ec9f-7442-4e87-8d48-29d0afaafe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.496053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78ec9f-7442-4e87-8d48-29d0afaafe59 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.496331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78ec9f-7442-4e87-8d48-29d0afaafe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.496601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78ec9f-7442-4e87-8d48-29d0afaafe59 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.497840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78ec9f-7442-4e87-8d48-29d0afaafe59 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.500086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78ec9f-7442-4e87-8d48-29d0afaafe59 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.501786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 90/183] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:09.508919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95369-f106-4538-bb1e-a191d79f85e0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.517822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95369-f106-4538-bb1e-a191d79f85e0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.522318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8231fa-ce10-4916-bcb0-d017e6518e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.523157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8231fa-ce10-4916-bcb0-d017e6518e7d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.523540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8231fa-ce10-4916-bcb0-d017e6518e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.523946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8231fa-ce10-4916-bcb0-d017e6518e7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.524927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8231fa-ce10-4916-bcb0-d017e6518e7d admin admin] RBAC: Adding query filter params (role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=3c6f764cee714a30baaf63707c28b80f, user.id=33a0b74416ef4bec9cc68a2c97e65985) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:09.525426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8231fa-ce10-4916-bcb0-d017e6518e7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.527541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8231fa-ce10-4916-bcb0-d017e6518e7d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.534174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 94/184] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/role_assignments?user.id=33a0b74416ef4bec9cc68a2c97e65985&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:09.739497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7897-5a6c-474f-a57f-a68dc67d33be None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.739497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7897-5a6c-474f-a57f-a68dc67d33be None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.739497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7897-5a6c-474f-a57f-a68dc67d33be None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.739497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 91/185] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:09.745722 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49a9db-fe6d-46e1-8e53-1c039dab0404 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.746122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49a9db-fe6d-46e1-8e53-1c039dab0404 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.746506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49a9db-fe6d-46e1-8e53-1c039dab0404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.764531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8b49a9db-fe6d-46e1-8e53-1c039dab0404 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:09.765804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8b49a9db-fe6d-46e1-8e53-1c039dab0404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:09.773791 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 95/186] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:09.798385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7897-5a6c-474f-a57f-a68dc67d33be None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.810999 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7897-5a6c-474f-a57f-a68dc67d33be None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.815124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbc5b6-cfca-4cc1-ad64-300de2ec109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.816671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbc5b6-cfca-4cc1-ad64-300de2ec109d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.816671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbc5b6-cfca-4cc1-ad64-300de2ec109d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.816671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbc5b6-cfca-4cc1-ad64-300de2ec109d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.818597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbc5b6-cfca-4cc1-ad64-300de2ec109d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.820451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbc5b6-cfca-4cc1-ad64-300de2ec109d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.821990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 92/187] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:09.828225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49a9db-fe6d-46e1-8e53-1c039dab0404 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:09.837158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49a9db-fe6d-46e1-8e53-1c039dab0404 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:09.841619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b295e-1075-4b4a-83c7-f3267ebcfb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:09.842281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b295e-1075-4b4a-83c7-f3267ebcfb17 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:09.842560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b295e-1075-4b4a-83c7-f3267ebcfb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:09.842834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b295e-1075-4b4a-83c7-f3267ebcfb17 admin admin] PATH_INFO: `/v3/groups` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:09.843527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b295e-1075-4b4a-83c7-f3267ebcfb17 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:09.844575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-f45b295e-1075-4b4a-83c7-f3267ebcfb17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:09.844575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:09.844575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:09.845762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b295e-1075-4b4a-83c7-f3267ebcfb17 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:09.864400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 96/188] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Jul 28 03:25:09 2021] POST /identity/v3/groups => generated 229 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:25:11.029748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76edb0-39ab-472e-b1d3-25c6e5c921dc None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.030288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76edb0-39ab-472e-b1d3-25c6e5c921dc None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.030288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76edb0-39ab-472e-b1d3-25c6e5c921dc None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.032100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 93/189] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:11.039636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5be01-d2b1-46ac-97c4-d87f8585f551 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.039636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5be01-d2b1-46ac-97c4-d87f8585f551 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.039636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5be01-d2b1-46ac-97c4-d87f8585f551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.060415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-12e5be01-d2b1-46ac-97c4-d87f8585f551 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:11.061828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-12e5be01-d2b1-46ac-97c4-d87f8585f551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:11.069916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 97/190] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:11.093790 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76edb0-39ab-472e-b1d3-25c6e5c921dc None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.106514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76edb0-39ab-472e-b1d3-25c6e5c921dc None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.110819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726a35-5382-4b80-b7f0-b52a0bec9594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.111807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726a35-5382-4b80-b7f0-b52a0bec9594 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.112223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726a35-5382-4b80-b7f0-b52a0bec9594 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.112648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726a35-5382-4b80-b7f0-b52a0bec9594 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.127737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d726a35-5382-4b80-b7f0-b52a0bec9594 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:11.131176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-4d726a35-5382-4b80-b7f0-b52a0bec9594 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:11.132994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 94/191] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:11.139281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5be01-d2b1-46ac-97c4-d87f8585f551 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.148677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5be01-d2b1-46ac-97c4-d87f8585f551 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.153147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.153818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.154094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.154364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.155119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] RBAC: Adding query filter params (name=member) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:11.155424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.157068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.168069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 98/192] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:11.173041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726a35-5382-4b80-b7f0-b52a0bec9594 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.182608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726a35-5382-4b80-b7f0-b52a0bec9594 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.193041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c3331-6868-4692-b7be-6d2cf01a5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.194139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c3331-6868-4692-b7be-6d2cf01a5d56 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.194765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c3331-6868-4692-b7be-6d2cf01a5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.195222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c3331-6868-4692-b7be-6d2cf01a5d56 admin admin] PATH_INFO: `/v3/users/33a0b74416ef4bec9cc68a2c97e65985` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.196625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c3331-6868-4692-b7be-6d2cf01a5d56 admin admin] RBAC: Authorizing `identity:get_user(user_id=33a0b74416ef4bec9cc68a2c97e65985)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.198933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c3331-6868-4692-b7be-6d2cf01a5d56 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.200694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 95/193] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/users/33a0b74416ef4bec9cc68a2c97e65985 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:11.207742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.217318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac7de-8da4-43bc-885e-e5fe9e802a3d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.221463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec767-08e1-451e-beed-868666bfd75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.222310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec767-08e1-451e-beed-868666bfd75b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.222588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec767-08e1-451e-beed-868666bfd75b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.222859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec767-08e1-451e-beed-868666bfd75b admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.224010 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ec767-08e1-451e-beed-868666bfd75b admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.227113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ec767-08e1-451e-beed-868666bfd75b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.229086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 99/194] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:11.235144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c3331-6868-4692-b7be-6d2cf01a5d56 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.245309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c3331-6868-4692-b7be-6d2cf01a5d56 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.249441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3680ed-8a58-4539-bd7d-474c2551f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.250310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3680ed-8a58-4539-bd7d-474c2551f404 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.250584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3680ed-8a58-4539-bd7d-474c2551f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.250850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3680ed-8a58-4539-bd7d-474c2551f404 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f/users/33a0b74416ef4bec9cc68a2c97e65985/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.252703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3680ed-8a58-4539-bd7d-474c2551f404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6f764cee714a30baaf63707c28b80f, user_id=33a0b74416ef4bec9cc68a2c97e65985, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.255315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3680ed-8a58-4539-bd7d-474c2551f404 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.268909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 96/195] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:11 2021] PUT /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f/users/33a0b74416ef4bec9cc68a2c97e65985/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:11.525468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2d19-f4c2-4623-9bf2-bb220347576c None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.525964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2d19-f4c2-4623-9bf2-bb220347576c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.526349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2d19-f4c2-4623-9bf2-bb220347576c None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.528254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 100/196] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:11.534515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0c30-6454-4474-a547-d76270d924c8 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.534936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0c30-6454-4474-a547-d76270d924c8 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.535306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0c30-6454-4474-a547-d76270d924c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.553128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2cab0c30-6454-4474-a547-d76270d924c8 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:11.554684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2cab0c30-6454-4474-a547-d76270d924c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:11.612688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 97/197] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:11.637246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2d19-f4c2-4623-9bf2-bb220347576c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.650124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2d19-f4c2-4623-9bf2-bb220347576c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.654417 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3507-8c3a-41da-bf23-54cb9472e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.655234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3507-8c3a-41da-bf23-54cb9472e6ae admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.655513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3507-8c3a-41da-bf23-54cb9472e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.655819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3507-8c3a-41da-bf23-54cb9472e6ae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.668227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c3507-8c3a-41da-bf23-54cb9472e6ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:11.675160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-da4c3507-8c3a-41da-bf23-54cb9472e6ae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:11.676888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 101/198] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:11.684015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0c30-6454-4474-a547-d76270d924c8 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.692649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0c30-6454-4474-a547-d76270d924c8 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.697752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0746-625a-4419-aac6-90e96e4bab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.698420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0746-625a-4419-aac6-90e96e4bab97 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.698696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0746-625a-4419-aac6-90e96e4bab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.698969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0746-625a-4419-aac6-90e96e4bab97 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.699733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce0746-625a-4419-aac6-90e96e4bab97 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:11.700039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce0746-625a-4419-aac6-90e96e4bab97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.701629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce0746-625a-4419-aac6-90e96e4bab97 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.710710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 98/199] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:11.716875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3507-8c3a-41da-bf23-54cb9472e6ae admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.720614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1b21a-cd4b-45e2-8125-7bb35c9403c6 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.721130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1b21a-cd4b-45e2-8125-7bb35c9403c6 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.721628 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1b21a-cd4b-45e2-8125-7bb35c9403c6 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.723587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 99/200] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:11.727855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3507-8c3a-41da-bf23-54cb9472e6ae admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.730598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97501a2-3369-4194-8ec6-f272514ba7b1 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.731149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97501a2-3369-4194-8ec6-f272514ba7b1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.731618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97501a2-3369-4194-8ec6-f272514ba7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.732479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b1610-2387-4225-bb91-d5e0bb81bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.733340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1610-2387-4225-bb91-d5e0bb81bfea admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.733610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1610-2387-4225-bb91-d5e0bb81bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.733877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1610-2387-4225-bb91-d5e0bb81bfea admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.735001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b1610-2387-4225-bb91-d5e0bb81bfea admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.736929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b1610-2387-4225-bb91-d5e0bb81bfea admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.738476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 102/201] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:11.745794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b1610-2387-4225-bb91-d5e0bb81bfea admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.754710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b1610-2387-4225-bb91-d5e0bb81bfea admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.756265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b97501a2-3369-4194-8ec6-f272514ba7b1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:11.758675 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b97501a2-3369-4194-8ec6-f272514ba7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:11.760279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b171df-75d6-4c15-9bff-bc983825a30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.761255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b171df-75d6-4c15-9bff-bc983825a30d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.761632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b171df-75d6-4c15-9bff-bc983825a30d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.762004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b171df-75d6-4c15-9bff-bc983825a30d admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.763223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b171df-75d6-4c15-9bff-bc983825a30d admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.765394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b171df-75d6-4c15-9bff-bc983825a30d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.767044 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 100/202] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:11.771744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 103/203] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:11.774214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97501a2-3369-4194-8ec6-f272514ba7b1 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.786800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97501a2-3369-4194-8ec6-f272514ba7b1 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.791688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b80fa-b7eb-4e3e-802e-689276424a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.792594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b80fa-b7eb-4e3e-802e-689276424a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.792875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b80fa-b7eb-4e3e-802e-689276424a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.793144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b80fa-b7eb-4e3e-802e-689276424a16 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f/users/398ba2372d694a5b8498f1f6df8ec46d/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.794998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b80fa-b7eb-4e3e-802e-689276424a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6f764cee714a30baaf63707c28b80f, user_id=398ba2372d694a5b8498f1f6df8ec46d, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.795422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b171df-75d6-4c15-9bff-bc983825a30d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.797645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b80fa-b7eb-4e3e-802e-689276424a16 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.806344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b171df-75d6-4c15-9bff-bc983825a30d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.812117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 101/204] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:11 2021] PUT /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f/users/398ba2372d694a5b8498f1f6df8ec46d/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:11.871881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66eb42-7181-44df-86d6-3ab0b2837fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.873268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66eb42-7181-44df-86d6-3ab0b2837fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.873798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66eb42-7181-44df-86d6-3ab0b2837fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.874282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66eb42-7181-44df-86d6-3ab0b2837fd0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.887334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66eb42-7181-44df-86d6-3ab0b2837fd0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:11.895754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-9e66eb42-7181-44df-86d6-3ab0b2837fd0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:11.897394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 104/205] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:11.907417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b80fa-b7eb-4e3e-802e-689276424a16 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.918905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b80fa-b7eb-4e3e-802e-689276424a16 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.923792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.924851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.925325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.925788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.926865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:11.927462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.929835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.939871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 102/206] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:11.950463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66eb42-7181-44df-86d6-3ab0b2837fd0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:11.962505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66eb42-7181-44df-86d6-3ab0b2837fd0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:11.967756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3e78d-123d-46a1-91b9-f3331b2333d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:11.968978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3e78d-123d-46a1-91b9-f3331b2333d0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:11.969503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3e78d-123d-46a1-91b9-f3331b2333d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:11.969969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3e78d-123d-46a1-91b9-f3331b2333d0 admin admin] PATH_INFO: `/v3/users/33a0b74416ef4bec9cc68a2c97e65985` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:11.972308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3e78d-123d-46a1-91b9-f3331b2333d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=33a0b74416ef4bec9cc68a2c97e65985)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:11.974806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3e78d-123d-46a1-91b9-f3331b2333d0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:11.977798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 105/207] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/users/33a0b74416ef4bec9cc68a2c97e65985 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:11.994144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:12.004724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2882e-b46a-4041-8b2d-4c8b4a668073 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:12.009045 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567eb06c-aab5-4234-8b23-386367ee0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:12.009897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567eb06c-aab5-4234-8b23-386367ee0ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:12.010175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567eb06c-aab5-4234-8b23-386367ee0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:12.010444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567eb06c-aab5-4234-8b23-386367ee0ef7 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:12.011547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567eb06c-aab5-4234-8b23-386367ee0ef7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:12.013627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567eb06c-aab5-4234-8b23-386367ee0ef7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:12.015405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 103/208] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:11 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:12.021412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3e78d-123d-46a1-91b9-f3331b2333d0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:12.033700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3e78d-123d-46a1-91b9-f3331b2333d0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:12.041542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c232be-7be2-4477-b845-3774866ff971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:12.043123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c232be-7be2-4477-b845-3774866ff971 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:12.043617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c232be-7be2-4477-b845-3774866ff971 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:12.044130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c232be-7be2-4477-b845-3774866ff971 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f/users/33a0b74416ef4bec9cc68a2c97e65985/roles/86c69e4b7605423ebcc1c4d6bc21c052` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:12.046449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c232be-7be2-4477-b845-3774866ff971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6f764cee714a30baaf63707c28b80f, user_id=33a0b74416ef4bec9cc68a2c97e65985, role_id=86c69e4b7605423ebcc1c4d6bc21c052)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:12.049339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c232be-7be2-4477-b845-3774866ff971 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:12.066218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 106/209] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:12 2021] PUT /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f/users/33a0b74416ef4bec9cc68a2c97e65985/roles/86c69e4b7605423ebcc1c4d6bc21c052 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:12.124617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047aba98-81db-4e0d-9cdd-77e16a29198f None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:12.124988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047aba98-81db-4e0d-9cdd-77e16a29198f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:12.125168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047aba98-81db-4e0d-9cdd-77e16a29198f None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:12.127116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 104/210] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:12.133992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476e811-a7f9-434d-8741-71247297563d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:12.134629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476e811-a7f9-434d-8741-71247297563d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:12.135123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476e811-a7f9-434d-8741-71247297563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:12.157997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-4476e811-a7f9-434d-8741-71247297563d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:12.157997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4476e811-a7f9-434d-8741-71247297563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:12.227899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 107/211] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:12.248464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047aba98-81db-4e0d-9cdd-77e16a29198f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:12.262607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047aba98-81db-4e0d-9cdd-77e16a29198f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:12.266747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e17e8e-cb58-4747-a0f4-b97ea28342cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:12.267518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17e8e-cb58-4747-a0f4-b97ea28342cf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:12.267826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17e8e-cb58-4747-a0f4-b97ea28342cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:12.268100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17e8e-cb58-4747-a0f4-b97ea28342cf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:12.269208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e17e8e-cb58-4747-a0f4-b97ea28342cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:12.270896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e17e8e-cb58-4747-a0f4-b97ea28342cf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:12.272537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 105/212] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:12.279397 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476e811-a7f9-434d-8741-71247297563d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:12.293323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476e811-a7f9-434d-8741-71247297563d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:12.296434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a18ed7-0762-49dd-bfe9-c2384a9e3e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:12.297115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a18ed7-0762-49dd-bfe9-c2384a9e3e7a admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:12.297395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a18ed7-0762-49dd-bfe9-c2384a9e3e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:12.297671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a18ed7-0762-49dd-bfe9-c2384a9e3e7a admin admin] PATH_INFO: `/v3/groups` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:12.298379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a18ed7-0762-49dd-bfe9-c2384a9e3e7a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:12.300316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a18ed7-0762-49dd-bfe9-c2384a9e3e7a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:12.322703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 108/213] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Jul 28 03:25:12 2021] POST /identity/v3/groups => generated 226 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:13.629246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224347f-de30-489b-8083-565cd73e9bb8 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:13.629246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224347f-de30-489b-8083-565cd73e9bb8 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:13.629246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224347f-de30-489b-8083-565cd73e9bb8 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:13.629246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 106/214] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:13.641933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24afa23-2f98-4b3e-90bb-2f5903dccd5c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:13.642420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24afa23-2f98-4b3e-90bb-2f5903dccd5c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:13.642502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24afa23-2f98-4b3e-90bb-2f5903dccd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:13.665101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e24afa23-2f98-4b3e-90bb-2f5903dccd5c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:13.666260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e24afa23-2f98-4b3e-90bb-2f5903dccd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:13.673825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 109/215] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:13.722100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224347f-de30-489b-8083-565cd73e9bb8 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:13.738583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224347f-de30-489b-8083-565cd73e9bb8 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:13.745517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ec179-4d39-4343-b89b-b17ea44569e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:13.746555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec179-4d39-4343-b89b-b17ea44569e2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:13.747028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec179-4d39-4343-b89b-b17ea44569e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:13.747514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec179-4d39-4343-b89b-b17ea44569e2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:13.765866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ec179-4d39-4343-b89b-b17ea44569e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:13.773735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d04ec179-4d39-4343-b89b-b17ea44569e2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:13.775189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 107/216] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:13.781767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24afa23-2f98-4b3e-90bb-2f5903dccd5c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:13.795008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24afa23-2f98-4b3e-90bb-2f5903dccd5c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:13.799321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:13.800019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:13.800299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:13.800571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:13.801325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] RBAC: Adding query filter params (name=member) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:13.801630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:13.803268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:13.821930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 110/217] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:13.827986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ec179-4d39-4343-b89b-b17ea44569e2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:13.845883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ec179-4d39-4343-b89b-b17ea44569e2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:13.854821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27f36-e3da-4b71-b93d-6eb4a21c6095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:13.856024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27f36-e3da-4b71-b93d-6eb4a21c6095 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:13.856504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27f36-e3da-4b71-b93d-6eb4a21c6095 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:13.856968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27f36-e3da-4b71-b93d-6eb4a21c6095 admin admin] PATH_INFO: `/v3/users/33a0b74416ef4bec9cc68a2c97e65985` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:13.858964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd27f36-e3da-4b71-b93d-6eb4a21c6095 admin admin] RBAC: Authorizing `identity:get_user(user_id=33a0b74416ef4bec9cc68a2c97e65985)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:13.861326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd27f36-e3da-4b71-b93d-6eb4a21c6095 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:13.863263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 108/218] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:13 2021] GET /identity/v3/users/33a0b74416ef4bec9cc68a2c97e65985 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:13.869405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:13.879014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9bcf1-7f13-44f3-8945-3ecc6b9b240d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:13.888413 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ede3e1-e32e-4300-8a1f-80050b1ae97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:13.889018 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ede3e1-e32e-4300-8a1f-80050b1ae97f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:13.889300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ede3e1-e32e-4300-8a1f-80050b1ae97f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:13.889578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ede3e1-e32e-4300-8a1f-80050b1ae97f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:13.904628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ede3e1-e32e-4300-8a1f-80050b1ae97f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:13.906414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ede3e1-e32e-4300-8a1f-80050b1ae97f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:13.916629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 111/219] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:13.922543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27f36-e3da-4b71-b93d-6eb4a21c6095 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:13.935456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27f36-e3da-4b71-b93d-6eb4a21c6095 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:13.943511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30920eb-741b-47d0-a961-4a289b54fcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:13.944889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30920eb-741b-47d0-a961-4a289b54fcbf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:13.945621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30920eb-741b-47d0-a961-4a289b54fcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:13.946097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30920eb-741b-47d0-a961-4a289b54fcbf admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:13.948234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30920eb-741b-47d0-a961-4a289b54fcbf admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:13.950553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30920eb-741b-47d0-a961-4a289b54fcbf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:13.952541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 109/220] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:13 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:13.959130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ede3e1-e32e-4300-8a1f-80050b1ae97f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:13.969029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ede3e1-e32e-4300-8a1f-80050b1ae97f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:13.973621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a0a51-3ab1-499b-868d-10eef8fe8f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:13.974556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0a51-3ab1-499b-868d-10eef8fe8f1b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:13.975073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0a51-3ab1-499b-868d-10eef8fe8f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:13.976462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0a51-3ab1-499b-868d-10eef8fe8f1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:13.977760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a0a51-3ab1-499b-868d-10eef8fe8f1b admin admin] RBAC: Adding query filter params (role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=3c6f764cee714a30baaf63707c28b80f, user.id=33a0b74416ef4bec9cc68a2c97e65985) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:13.978267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a0a51-3ab1-499b-868d-10eef8fe8f1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:13.980477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a0a51-3ab1-499b-868d-10eef8fe8f1b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:13.987056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 112/221] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:13 2021] GET /identity/v3/role_assignments?user.id=33a0b74416ef4bec9cc68a2c97e65985&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:14.637721 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6672-9321-4aed-9b6b-72ddf14bf8c4 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.638712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6672-9321-4aed-9b6b-72ddf14bf8c4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.639211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6672-9321-4aed-9b6b-72ddf14bf8c4 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.641585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 110/222] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:14.647575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617211f-a3c8-4aa0-88b8-74793a2dbe4d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.648711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617211f-a3c8-4aa0-88b8-74793a2dbe4d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.649183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617211f-a3c8-4aa0-88b8-74793a2dbe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.672811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-7617211f-a3c8-4aa0-88b8-74793a2dbe4d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:14.674355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7617211f-a3c8-4aa0-88b8-74793a2dbe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:14.687425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 113/223] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:14.730164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6672-9321-4aed-9b6b-72ddf14bf8c4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:14.744886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6672-9321-4aed-9b6b-72ddf14bf8c4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:14.749486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96e11-23bd-4b14-87f8-fe543e1da3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:14.750571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96e11-23bd-4b14-87f8-fe543e1da3ba admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.751043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96e11-23bd-4b14-87f8-fe543e1da3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.751505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96e11-23bd-4b14-87f8-fe543e1da3ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.773181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c96e11-23bd-4b14-87f8-fe543e1da3ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:14.780556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-69c96e11-23bd-4b14-87f8-fe543e1da3ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:14.782041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 111/224] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:14.789123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617211f-a3c8-4aa0-88b8-74793a2dbe4d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:14.797953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617211f-a3c8-4aa0-88b8-74793a2dbe4d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:14.807875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fd6dd-ce41-4474-b475-750de1c5993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:14.808847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fd6dd-ce41-4474-b475-750de1c5993b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.809321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fd6dd-ce41-4474-b475-750de1c5993b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.809785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fd6dd-ce41-4474-b475-750de1c5993b admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.810744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fd6dd-ce41-4474-b475-750de1c5993b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:14.811237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fd6dd-ce41-4474-b475-750de1c5993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:14.813205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fd6dd-ce41-4474-b475-750de1c5993b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:14.828031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 114/225] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:14.834021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96e11-23bd-4b14-87f8-fe543e1da3ba admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:14.846583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96e11-23bd-4b14-87f8-fe543e1da3ba admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:14.851823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dd169-d429-45ea-b9ce-52f01f75ebb4 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.852427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dd169-d429-45ea-b9ce-52f01f75ebb4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.853006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dd169-d429-45ea-b9ce-52f01f75ebb4 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.855054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 115/226] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:14.859944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444405cf-a8a7-4745-a9b5-0c0796421926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:14.861647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a34cf-b57c-400d-818f-9abe1579f0eb None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.862151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a34cf-b57c-400d-818f-9abe1579f0eb None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.862677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a34cf-b57c-400d-818f-9abe1579f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.863824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444405cf-a8a7-4745-a9b5-0c0796421926 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.865563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444405cf-a8a7-4745-a9b5-0c0796421926 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.866030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444405cf-a8a7-4745-a9b5-0c0796421926 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.870020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444405cf-a8a7-4745-a9b5-0c0796421926 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:14.872067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444405cf-a8a7-4745-a9b5-0c0796421926 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:14.880723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 112/227] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:14 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:14.887409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444405cf-a8a7-4745-a9b5-0c0796421926 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:14.903992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-302a34cf-b57c-400d-818f-9abe1579f0eb None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:14.906086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444405cf-a8a7-4745-a9b5-0c0796421926 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:14.908906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-302a34cf-b57c-400d-818f-9abe1579f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:14.915238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f467-ee2b-48d0-b0d0-1c7762ffa013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:14.918147 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f467-ee2b-48d0-b0d0-1c7762ffa013 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.919310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f467-ee2b-48d0-b0d0-1c7762ffa013 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.920455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f467-ee2b-48d0-b0d0-1c7762ffa013 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.927102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 116/228] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:14.935438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2f467-ee2b-48d0-b0d0-1c7762ffa013 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:14.937552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2f467-ee2b-48d0-b0d0-1c7762ffa013 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:14.949340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 113/229] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:14.955540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a34cf-b57c-400d-818f-9abe1579f0eb None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:14.965665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a34cf-b57c-400d-818f-9abe1579f0eb None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:14.969382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f467-ee2b-48d0-b0d0-1c7762ffa013 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:14.977189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98bf56-2b02-4521-b5ac-2f8b88798d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:14.978402 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98bf56-2b02-4521-b5ac-2f8b88798d9e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:14.979086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98bf56-2b02-4521-b5ac-2f8b88798d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:14.980044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98bf56-2b02-4521-b5ac-2f8b88798d9e admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:14.982087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98bf56-2b02-4521-b5ac-2f8b88798d9e admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:14.987408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f467-ee2b-48d0-b0d0-1c7762ffa013 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:14.989803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98bf56-2b02-4521-b5ac-2f8b88798d9e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:14.993826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 117/230] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:14 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:14.998214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b760aa-5fd9-4448-9fab-f21482bdeb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:14.999309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b760aa-5fd9-4448-9fab-f21482bdeb12 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.000386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98bf56-2b02-4521-b5ac-2f8b88798d9e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.001629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b760aa-5fd9-4448-9fab-f21482bdeb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.003506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b760aa-5fd9-4448-9fab-f21482bdeb12 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.016042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98bf56-2b02-4521-b5ac-2f8b88798d9e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.031084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.031922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b760aa-5fd9-4448-9fab-f21482bdeb12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:15.034319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.034881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.035397 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.036447 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=3c6f764cee714a30baaf63707c28b80f, user.id=398ba2372d694a5b8498f1f6df8ec46d) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:15.037933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.042431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.054091 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d2b760aa-5fd9-4448-9fab-f21482bdeb12 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:15.056671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 114/231] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:15.059004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 118/232] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:14 2021] GET /identity/v3/role_assignments?user.id=398ba2372d694a5b8498f1f6df8ec46d&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:15.063777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b760aa-5fd9-4448-9fab-f21482bdeb12 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.074670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b760aa-5fd9-4448-9fab-f21482bdeb12 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.080199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.081142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.081616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.082163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.083118 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:15.083654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.086395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.101139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 115/233] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:15.107731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.118335 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cb955-7fe9-49df-a78d-fb9c3a112f32 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.128907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d837d-300a-470a-8a74-e3141f83c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.129927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d837d-300a-470a-8a74-e3141f83c7fe admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.130342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d837d-300a-470a-8a74-e3141f83c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.130742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d837d-300a-470a-8a74-e3141f83c7fe admin admin] PATH_INFO: `/v3/users/33a0b74416ef4bec9cc68a2c97e65985` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.132187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d837d-300a-470a-8a74-e3141f83c7fe admin admin] RBAC: Authorizing `identity:get_user(user_id=33a0b74416ef4bec9cc68a2c97e65985)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.134682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d837d-300a-470a-8a74-e3141f83c7fe admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.136513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 119/234] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/users/33a0b74416ef4bec9cc68a2c97e65985 => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:15.143113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.154641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aff994-14e6-4aff-91ca-39322318352e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.159399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd960-0df2-4931-a55d-e35e0b1c76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.160136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd960-0df2-4931-a55d-e35e0b1c76a5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.160462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd960-0df2-4931-a55d-e35e0b1c76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.160783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd960-0df2-4931-a55d-e35e0b1c76a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.175800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd960-0df2-4931-a55d-e35e0b1c76a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.177714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd960-0df2-4931-a55d-e35e0b1c76a5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.188734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 116/235] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:15.195425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d837d-300a-470a-8a74-e3141f83c7fe admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.205415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d837d-300a-470a-8a74-e3141f83c7fe admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.213709 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d715d6-d0b1-4ad8-9425-b563f4acf111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.214633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d715d6-d0b1-4ad8-9425-b563f4acf111 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.214910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d715d6-d0b1-4ad8-9425-b563f4acf111 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.215179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d715d6-d0b1-4ad8-9425-b563f4acf111 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.216398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d715d6-d0b1-4ad8-9425-b563f4acf111 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.218698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d715d6-d0b1-4ad8-9425-b563f4acf111 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.220603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 120/236] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:15.227936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd960-0df2-4931-a55d-e35e0b1c76a5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.236964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd960-0df2-4931-a55d-e35e0b1c76a5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.243228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadd5ea-d27a-4bdf-a4f7-a34ec02ca1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.244016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd5ea-d27a-4bdf-a4f7-a34ec02ca1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.244296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd5ea-d27a-4bdf-a4f7-a34ec02ca1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.244616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd5ea-d27a-4bdf-a4f7-a34ec02ca1d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.245464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd5ea-d27a-4bdf-a4f7-a34ec02ca1d8 admin admin] RBAC: Adding query filter params (role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=3c6f764cee714a30baaf63707c28b80f, user.id=33a0b74416ef4bec9cc68a2c97e65985) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:15.245821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd5ea-d27a-4bdf-a4f7-a34ec02ca1d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.247792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd5ea-d27a-4bdf-a4f7-a34ec02ca1d8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.256201 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 117/237] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/role_assignments?user.id=33a0b74416ef4bec9cc68a2c97e65985&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:15.600309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540859-59c2-4fce-9b8b-9dea8eb50930 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.600675 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540859-59c2-4fce-9b8b-9dea8eb50930 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.600980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540859-59c2-4fce-9b8b-9dea8eb50930 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.603111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 121/238] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:15.609685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff91ee-3902-4646-b3c6-d95aa45920c2 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.609974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff91ee-3902-4646-b3c6-d95aa45920c2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.610254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff91ee-3902-4646-b3c6-d95aa45920c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.633576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-deff91ee-3902-4646-b3c6-d95aa45920c2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:15.634742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-deff91ee-3902-4646-b3c6-d95aa45920c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:15.642439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 118/239] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:15.688688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26540859-59c2-4fce-9b8b-9dea8eb50930 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.702028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26540859-59c2-4fce-9b8b-9dea8eb50930 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.707314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721cf45-4d60-4b92-a4a9-3eb9828e298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.708145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721cf45-4d60-4b92-a4a9-3eb9828e298f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.708425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721cf45-4d60-4b92-a4a9-3eb9828e298f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.708700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721cf45-4d60-4b92-a4a9-3eb9828e298f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.721390 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721cf45-4d60-4b92-a4a9-3eb9828e298f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:15.728702 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-1721cf45-4d60-4b92-a4a9-3eb9828e298f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:15.729919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:15.736514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff91ee-3902-4646-b3c6-d95aa45920c2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.745777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff91ee-3902-4646-b3c6-d95aa45920c2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.750119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.750786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.751115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.751388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.752216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] RBAC: Adding query filter params (name=member) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:15.752514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.754146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.765993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 119/241] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:15.772679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721cf45-4d60-4b92-a4a9-3eb9828e298f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.789422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721cf45-4d60-4b92-a4a9-3eb9828e298f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.798833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2fc94-b3ec-4924-a2b1-ab2f54759351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.799487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2fc94-b3ec-4924-a2b1-ab2f54759351 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.799795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2fc94-b3ec-4924-a2b1-ab2f54759351 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.800073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2fc94-b3ec-4924-a2b1-ab2f54759351 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.810803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2fc94-b3ec-4924-a2b1-ab2f54759351 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.812661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2fc94-b3ec-4924-a2b1-ab2f54759351 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.825086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 123/242] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:15.831360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.845398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb82e-5fd6-4b30-95a0-004f77aaab5f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.853668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb081d-0dd3-490f-9662-b18ca9391f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.854557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb081d-0dd3-490f-9662-b18ca9391f08 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.854836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb081d-0dd3-490f-9662-b18ca9391f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.855109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb081d-0dd3-490f-9662-b18ca9391f08 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.856318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb081d-0dd3-490f-9662-b18ca9391f08 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.858476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb081d-0dd3-490f-9662-b18ca9391f08 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.860163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 120/243] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:15.866907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2fc94-b3ec-4924-a2b1-ab2f54759351 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.880489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2fc94-b3ec-4924-a2b1-ab2f54759351 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.887589 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0d11c-11dd-4616-95fe-2f65fa142a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.888472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0d11c-11dd-4616-95fe-2f65fa142a94 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.888757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0d11c-11dd-4616-95fe-2f65fa142a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.889034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0d11c-11dd-4616-95fe-2f65fa142a94 admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.902213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0d11c-11dd-4616-95fe-2f65fa142a94 admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.903251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-4aa0d11c-11dd-4616-95fe-2f65fa142a94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:15.903251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:15.903251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:15.904497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0d11c-11dd-4616-95fe-2f65fa142a94 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.906146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 124/244] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:15.913794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb081d-0dd3-490f-9662-b18ca9391f08 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:15.928751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb081d-0dd3-490f-9662-b18ca9391f08 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:15.938573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89cf50-a2c6-44cc-bdc1-8c7585d1a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:15.939288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89cf50-a2c6-44cc-bdc1-8c7585d1a254 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:15.939572 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89cf50-a2c6-44cc-bdc1-8c7585d1a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:15.939865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89cf50-a2c6-44cc-bdc1-8c7585d1a254 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:15.940752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89cf50-a2c6-44cc-bdc1-8c7585d1a254 admin admin] RBAC: Adding query filter params (group.id=faaff9292a464970adb868294f36a9d8, role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:15.941054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89cf50-a2c6-44cc-bdc1-8c7585d1a254 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:15.943006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89cf50-a2c6-44cc-bdc1-8c7585d1a254 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:15.952050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 121/245] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:15 2021] GET /identity/v3/role_assignments?group.id=faaff9292a464970adb868294f36a9d8&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:16.150637 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19606-bbcf-49ba-ae21-c2e33ed488bf None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.150955 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19606-bbcf-49ba-ae21-c2e33ed488bf None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.151195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19606-bbcf-49ba-ae21-c2e33ed488bf None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.153312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 125/246] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:16.159164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b344825-ba8a-46b6-9aee-4ad293a850ad None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.159452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b344825-ba8a-46b6-9aee-4ad293a850ad None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.159758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b344825-ba8a-46b6-9aee-4ad293a850ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.181247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2b344825-ba8a-46b6-9aee-4ad293a850ad None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:16.182406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2b344825-ba8a-46b6-9aee-4ad293a850ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:16.197870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 122/247] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:16.241436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19606-bbcf-49ba-ae21-c2e33ed488bf None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:16.259834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19606-bbcf-49ba-ae21-c2e33ed488bf None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:16.264156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a13af3-f810-4e59-aea0-3c15a87cad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:16.264970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a13af3-f810-4e59-aea0-3c15a87cad70 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.265252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a13af3-f810-4e59-aea0-3c15a87cad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.265530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a13af3-f810-4e59-aea0-3c15a87cad70 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.279973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a13af3-f810-4e59-aea0-3c15a87cad70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:16.287042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-08a13af3-f810-4e59-aea0-3c15a87cad70 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:16.288550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 126/248] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:16.297055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b344825-ba8a-46b6-9aee-4ad293a850ad None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:16.308069 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b344825-ba8a-46b6-9aee-4ad293a850ad None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:16.313159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:16.313881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.314167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.314445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.315199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:16.315500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:16.317188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:16.328768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 123/249] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:16.335844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a13af3-f810-4e59-aea0-3c15a87cad70 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:16.346915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a13af3-f810-4e59-aea0-3c15a87cad70 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:16.354401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367bac-90a8-43a2-8e4d-290f87071e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:16.355051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367bac-90a8-43a2-8e4d-290f87071e97 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.355381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367bac-90a8-43a2-8e4d-290f87071e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.355665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367bac-90a8-43a2-8e4d-290f87071e97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.364343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f367bac-90a8-43a2-8e4d-290f87071e97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:16.366277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f367bac-90a8-43a2-8e4d-290f87071e97 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:16.378117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 127/250] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:16.382293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:16.391595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bbe5c-ac4a-4e9b-86a8-97fdde2dc8dd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:16.397953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623085-664a-496c-bd09-1432e03936a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:16.398871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623085-664a-496c-bd09-1432e03936a1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.399149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623085-664a-496c-bd09-1432e03936a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.399419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623085-664a-496c-bd09-1432e03936a1 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.401359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623085-664a-496c-bd09-1432e03936a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:16.403491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623085-664a-496c-bd09-1432e03936a1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:16.405311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 124/251] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:16.411565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367bac-90a8-43a2-8e4d-290f87071e97 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:16.420976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367bac-90a8-43a2-8e4d-290f87071e97 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:16.432191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0a3d2-81da-41fe-861c-b5c7388cb195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:16.433125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0a3d2-81da-41fe-861c-b5c7388cb195 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.433503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0a3d2-81da-41fe-861c-b5c7388cb195 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.433777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0a3d2-81da-41fe-861c-b5c7388cb195 admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.434971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0a3d2-81da-41fe-861c-b5c7388cb195 admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:16.437077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0a3d2-81da-41fe-861c-b5c7388cb195 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:16.440008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 128/252] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:16.446204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623085-664a-496c-bd09-1432e03936a1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:16.456432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623085-664a-496c-bd09-1432e03936a1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:16.462123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d165b3c-6180-4aa6-ac5a-41e15e5159ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:16.462878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165b3c-6180-4aa6-ac5a-41e15e5159ca admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.463162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165b3c-6180-4aa6-ac5a-41e15e5159ca admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.463758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165b3c-6180-4aa6-ac5a-41e15e5159ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.464598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d165b3c-6180-4aa6-ac5a-41e15e5159ca admin admin] RBAC: Adding query filter params (group.id=faaff9292a464970adb868294f36a9d8, role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:16.464959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d165b3c-6180-4aa6-ac5a-41e15e5159ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:16.466946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d165b3c-6180-4aa6-ac5a-41e15e5159ca admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:16.476110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 125/253] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/role_assignments?group.id=faaff9292a464970adb868294f36a9d8&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:16.803778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502df3e-6ba3-496a-8527-c38deb42fca8 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.804448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502df3e-6ba3-496a-8527-c38deb42fca8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.804448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502df3e-6ba3-496a-8527-c38deb42fca8 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.806565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 129/254] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:16.812921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32f12d-b059-4181-a4d5-2617919cfb62 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.813462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32f12d-b059-4181-a4d5-2617919cfb62 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.813462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32f12d-b059-4181-a4d5-2617919cfb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.837017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-7b32f12d-b059-4181-a4d5-2617919cfb62 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:16.838177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7b32f12d-b059-4181-a4d5-2617919cfb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:16.847439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 126/255] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:16.884536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502df3e-6ba3-496a-8527-c38deb42fca8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:16.905273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502df3e-6ba3-496a-8527-c38deb42fca8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:16.909562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1f82-50a8-43ee-862b-2af1e82af5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:16.910356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f82-50a8-43ee-862b-2af1e82af5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.910641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f82-50a8-43ee-862b-2af1e82af5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.910908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f82-50a8-43ee-862b-2af1e82af5c8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.928910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1f82-50a8-43ee-862b-2af1e82af5c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:16.935989 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-6f3e1f82-50a8-43ee-862b-2af1e82af5c8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:16.942403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 130/256] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:16.943400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32f12d-b059-4181-a4d5-2617919cfb62 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:16.957914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32f12d-b059-4181-a4d5-2617919cfb62 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:16.972320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:16.973003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:16.973281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:16.973538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:16.974291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:16.974592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:16.976605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:16.985748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 127/257] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:16.992388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1f82-50a8-43ee-862b-2af1e82af5c8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.002111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1f82-50a8-43ee-862b-2af1e82af5c8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.010988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a289d-adbe-47b2-8215-e78e3572db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.011696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a289d-adbe-47b2-8215-e78e3572db94 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.012000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a289d-adbe-47b2-8215-e78e3572db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.012275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a289d-adbe-47b2-8215-e78e3572db94 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.021999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a289d-adbe-47b2-8215-e78e3572db94 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.024700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a289d-adbe-47b2-8215-e78e3572db94 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.034141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 131/258] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:17.040395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.049592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e1d8-5a9a-477e-ac7a-5ac1ea77eed5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.058921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b0433-e206-4d61-a7f0-2a5c941b4f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.059738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0433-e206-4d61-a7f0-2a5c941b4f24 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.060023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0433-e206-4d61-a7f0-2a5c941b4f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.060295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0433-e206-4d61-a7f0-2a5c941b4f24 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.062512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b0433-e206-4d61-a7f0-2a5c941b4f24 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.064591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b0433-e206-4d61-a7f0-2a5c941b4f24 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.066455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 128/259] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:17.074113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a289d-adbe-47b2-8215-e78e3572db94 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.087620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a289d-adbe-47b2-8215-e78e3572db94 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.095864 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e4aa8-7e46-43fe-a3df-052415906593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.096729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4aa8-7e46-43fe-a3df-052415906593 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.097012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4aa8-7e46-43fe-a3df-052415906593 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.097297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4aa8-7e46-43fe-a3df-052415906593 admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.104408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e4aa8-7e46-43fe-a3df-052415906593 admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.106321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e4aa8-7e46-43fe-a3df-052415906593 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.108107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 132/260] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:17.114580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b0433-e206-4d61-a7f0-2a5c941b4f24 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.132158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b0433-e206-4d61-a7f0-2a5c941b4f24 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.138477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20542776-61b8-4339-8c58-79c433511e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.139137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20542776-61b8-4339-8c58-79c433511e80 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.139418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20542776-61b8-4339-8c58-79c433511e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.139691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20542776-61b8-4339-8c58-79c433511e80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.140567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20542776-61b8-4339-8c58-79c433511e80 admin admin] RBAC: Adding query filter params (group.id=faaff9292a464970adb868294f36a9d8, role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=3c6f764cee714a30baaf63707c28b80f) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:17.140874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20542776-61b8-4339-8c58-79c433511e80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.142718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20542776-61b8-4339-8c58-79c433511e80 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.149692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 129/261] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/role_assignments?group.id=faaff9292a464970adb868294f36a9d8&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:17.447606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40aa19-7d4a-493f-9397-c73ba1488a2f None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.448029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40aa19-7d4a-493f-9397-c73ba1488a2f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.448194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40aa19-7d4a-493f-9397-c73ba1488a2f None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.449976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 133/262] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:17.456841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f036e9-0b69-44a9-b430-cc4936fe4624 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.457131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f036e9-0b69-44a9-b430-cc4936fe4624 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.457410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f036e9-0b69-44a9-b430-cc4936fe4624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.481533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-65f036e9-0b69-44a9-b430-cc4936fe4624 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:17.482693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-65f036e9-0b69-44a9-b430-cc4936fe4624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:17.496150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 130/263] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:17.522128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40aa19-7d4a-493f-9397-c73ba1488a2f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.537572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40aa19-7d4a-493f-9397-c73ba1488a2f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.546160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c01a9-bc9b-4b3b-bbdb-155502f5dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.546975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c01a9-bc9b-4b3b-bbdb-155502f5dac1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.547257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c01a9-bc9b-4b3b-bbdb-155502f5dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.547531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c01a9-bc9b-4b3b-bbdb-155502f5dac1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.560310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c01a9-bc9b-4b3b-bbdb-155502f5dac1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:17.567660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-647c01a9-bc9b-4b3b-bbdb-155502f5dac1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:17.568965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 134/264] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:17.575659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f036e9-0b69-44a9-b430-cc4936fe4624 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.584257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f036e9-0b69-44a9-b430-cc4936fe4624 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.595167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.595871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.596149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.596422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.597175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:17.597474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.599068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.615372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 131/265] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:17.622670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c01a9-bc9b-4b3b-bbdb-155502f5dac1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.636293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c01a9-bc9b-4b3b-bbdb-155502f5dac1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.643718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b8e0-1a80-45de-b8da-631e99265d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.644391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b8e0-1a80-45de-b8da-631e99265d1f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.644676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b8e0-1a80-45de-b8da-631e99265d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.644955 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b8e0-1a80-45de-b8da-631e99265d1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.656326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394b8e0-1a80-45de-b8da-631e99265d1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.658103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394b8e0-1a80-45de-b8da-631e99265d1f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.672149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 135/266] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:17.677982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.692444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff612-a742-4e12-9f16-70230bc7dad9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.699201 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92765-043d-4df9-bf8d-1f5fea9427fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.700040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92765-043d-4df9-bf8d-1f5fea9427fb admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.700319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92765-043d-4df9-bf8d-1f5fea9427fb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.700591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92765-043d-4df9-bf8d-1f5fea9427fb admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.704457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92765-043d-4df9-bf8d-1f5fea9427fb admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.706521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92765-043d-4df9-bf8d-1f5fea9427fb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.708221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 132/267] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:17.715274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b8e0-1a80-45de-b8da-631e99265d1f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.729191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b8e0-1a80-45de-b8da-631e99265d1f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.739736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce1e01-3891-474e-b5ed-9f9c425e9cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.740606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1e01-3891-474e-b5ed-9f9c425e9cae admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.740895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1e01-3891-474e-b5ed-9f9c425e9cae admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.741228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1e01-3891-474e-b5ed-9f9c425e9cae admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.743667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce1e01-3891-474e-b5ed-9f9c425e9cae admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.745616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce1e01-3891-474e-b5ed-9f9c425e9cae admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.747492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 136/268] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:17.753609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92765-043d-4df9-bf8d-1f5fea9427fb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:17.766136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92765-043d-4df9-bf8d-1f5fea9427fb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:17.770585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9df4-a42f-4068-b5be-818bb927b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:17.771252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9df4-a42f-4068-b5be-818bb927b15a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:17.771533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9df4-a42f-4068-b5be-818bb927b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:17.771830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9df4-a42f-4068-b5be-818bb927b15a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:17.773234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a9df4-a42f-4068-b5be-818bb927b15a admin admin] RBAC: Adding query filter params (group.id=faaff9292a464970adb868294f36a9d8, role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=3c6f764cee714a30baaf63707c28b80f) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:17.773546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a9df4-a42f-4068-b5be-818bb927b15a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:17.775403 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a9df4-a42f-4068-b5be-818bb927b15a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:17.786860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 133/269] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:17 2021] GET /identity/v3/role_assignments?group.id=faaff9292a464970adb868294f36a9d8&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:18.006613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47991-ec67-43c4-a4cb-65483f639733 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:18.007975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47991-ec67-43c4-a4cb-65483f639733 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:18.007975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47991-ec67-43c4-a4cb-65483f639733 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:18.009552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 137/270] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:18.015669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8b8d-8175-45c0-9081-abf8de63ab0b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:18.016581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8b8d-8175-45c0-9081-abf8de63ab0b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:18.017090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8b8d-8175-45c0-9081-abf8de63ab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:18.038433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2a7c8b8d-8175-45c0-9081-abf8de63ab0b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:18.040202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2a7c8b8d-8175-45c0-9081-abf8de63ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:18.052144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 134/271] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:18.078222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe47991-ec67-43c4-a4cb-65483f639733 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:18.091368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe47991-ec67-43c4-a4cb-65483f639733 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:18.097946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b1d97-b6dd-4ec9-9fab-811bd612fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:18.099027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b1d97-b6dd-4ec9-9fab-811bd612fc43 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:18.099528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b1d97-b6dd-4ec9-9fab-811bd612fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:18.100021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b1d97-b6dd-4ec9-9fab-811bd612fc43 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:18.116860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b1d97-b6dd-4ec9-9fab-811bd612fc43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:18.125462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-925b1d97-b6dd-4ec9-9fab-811bd612fc43 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:18.125462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 138/272] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:18.131757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8b8d-8175-45c0-9081-abf8de63ab0b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:18.144816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8b8d-8175-45c0-9081-abf8de63ab0b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:18.153017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:18.153717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:18.154001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:18.154277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:18.155044 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:18.155355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:18.157004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:18.171670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 135/273] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:18.177968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b1d97-b6dd-4ec9-9fab-811bd612fc43 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:18.193048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b1d97-b6dd-4ec9-9fab-811bd612fc43 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:18.202571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2f6f-1e7e-494b-92b5-a7598e7c069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:18.203236 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2f6f-1e7e-494b-92b5-a7598e7c069e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:18.203518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2f6f-1e7e-494b-92b5-a7598e7c069e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:18.203846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2f6f-1e7e-494b-92b5-a7598e7c069e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:18.215039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e2f6f-1e7e-494b-92b5-a7598e7c069e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:18.216845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e2f6f-1e7e-494b-92b5-a7598e7c069e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:18.229811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 139/274] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:18.236133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:18.250020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e42f3-3431-4295-84fe-f3da0394fd24 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:18.254397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27a67b-7806-415e-a208-02bffa998225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:18.255265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27a67b-7806-415e-a208-02bffa998225 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:18.255550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27a67b-7806-415e-a208-02bffa998225 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:18.255851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27a67b-7806-415e-a208-02bffa998225 admin admin] PATH_INFO: `/v3/projects/a74500eac66c48568f2eb64dd512dfc6` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:18.260521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27a67b-7806-415e-a208-02bffa998225 admin admin] RBAC: Authorizing `identity:get_project(project_id=a74500eac66c48568f2eb64dd512dfc6)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:18.262273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27a67b-7806-415e-a208-02bffa998225 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:18.264217 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 136/275] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:18 2021] GET /identity/v3/projects/a74500eac66c48568f2eb64dd512dfc6 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:18.270440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2f6f-1e7e-494b-92b5-a7598e7c069e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:18.284517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2f6f-1e7e-494b-92b5-a7598e7c069e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:18.289656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971e309-9b5f-4df3-92d2-bdb0bd6c1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:18.290514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971e309-9b5f-4df3-92d2-bdb0bd6c1a4f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:18.290798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971e309-9b5f-4df3-92d2-bdb0bd6c1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:18.291077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971e309-9b5f-4df3-92d2-bdb0bd6c1a4f admin admin] PATH_INFO: `/v3/groups/baee4808895f4dc7ad14cc5480c64f55` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:18.297812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971e309-9b5f-4df3-92d2-bdb0bd6c1a4f admin admin] RBAC: Authorizing `identity:get_group(group_id=baee4808895f4dc7ad14cc5480c64f55)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:18.299767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971e309-9b5f-4df3-92d2-bdb0bd6c1a4f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:18.301412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 140/276] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:18 2021] GET /identity/v3/groups/baee4808895f4dc7ad14cc5480c64f55 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:18.308974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27a67b-7806-415e-a208-02bffa998225 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:18.318219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27a67b-7806-415e-a208-02bffa998225 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:18.327672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffefb2-f2c2-442f-a36b-4e1dae8d1dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:18.328368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffefb2-f2c2-442f-a36b-4e1dae8d1dcf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:18.328652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffefb2-f2c2-442f-a36b-4e1dae8d1dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:18.328927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffefb2-f2c2-442f-a36b-4e1dae8d1dcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:18.329769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffefb2-f2c2-442f-a36b-4e1dae8d1dcf admin admin] RBAC: Adding query filter params (group.id=baee4808895f4dc7ad14cc5480c64f55, role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=a74500eac66c48568f2eb64dd512dfc6) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:18.330081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffefb2-f2c2-442f-a36b-4e1dae8d1dcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:18.331972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffefb2-f2c2-442f-a36b-4e1dae8d1dcf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:18.344084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 137/277] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:18 2021] GET /identity/v3/role_assignments?group.id=baee4808895f4dc7ad14cc5480c64f55&scope.project.id=a74500eac66c48568f2eb64dd512dfc6&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:19.016556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fcdb0-9dc3-46a9-82e1-0906f7b32e03 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.017319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fcdb0-9dc3-46a9-82e1-0906f7b32e03 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.017319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fcdb0-9dc3-46a9-82e1-0906f7b32e03 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.018894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 141/278] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:19.033918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b996e6-f8f2-4ecc-9b50-26a6c546a662 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.034495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b996e6-f8f2-4ecc-9b50-26a6c546a662 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.034495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b996e6-f8f2-4ecc-9b50-26a6c546a662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.060630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f0b996e6-f8f2-4ecc-9b50-26a6c546a662 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:19.061800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f0b996e6-f8f2-4ecc-9b50-26a6c546a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:19.070156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 138/279] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:19.106657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fcdb0-9dc3-46a9-82e1-0906f7b32e03 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.123005 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fcdb0-9dc3-46a9-82e1-0906f7b32e03 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.126885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecf82a-96e3-42f9-8a9f-41c4d7db6447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.127780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecf82a-96e3-42f9-8a9f-41c4d7db6447 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.128006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecf82a-96e3-42f9-8a9f-41c4d7db6447 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.128285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecf82a-96e3-42f9-8a9f-41c4d7db6447 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.140167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecf82a-96e3-42f9-8a9f-41c4d7db6447 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:19.146937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-69ecf82a-96e3-42f9-8a9f-41c4d7db6447 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:19.151830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 142/280] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:19.154941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b996e6-f8f2-4ecc-9b50-26a6c546a662 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.168860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b996e6-f8f2-4ecc-9b50-26a6c546a662 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.175606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.176567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.177051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.177522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.178559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:19.179148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:19.180992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:19.190205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 139/281] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:19.197387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecf82a-96e3-42f9-8a9f-41c4d7db6447 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.207340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecf82a-96e3-42f9-8a9f-41c4d7db6447 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.212860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb284da-5d39-4f6d-a36e-1addb0ac7c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.216418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb284da-5d39-4f6d-a36e-1addb0ac7c1d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.216704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb284da-5d39-4f6d-a36e-1addb0ac7c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.216982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb284da-5d39-4f6d-a36e-1addb0ac7c1d admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.218138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb284da-5d39-4f6d-a36e-1addb0ac7c1d admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:19.220160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb284da-5d39-4f6d-a36e-1addb0ac7c1d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:19.221707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 143/282] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:19 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:19.228532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.237928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55655-859f-476c-b8da-b06a96c11714 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.242289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efcfd2-e30d-4f6c-9b37-97296190e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.243150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcfd2-e30d-4f6c-9b37-97296190e483 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.243431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcfd2-e30d-4f6c-9b37-97296190e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.243723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcfd2-e30d-4f6c-9b37-97296190e483 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.244877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efcfd2-e30d-4f6c-9b37-97296190e483 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:19.247051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efcfd2-e30d-4f6c-9b37-97296190e483 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:19.248772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 140/283] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:19 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:19.260136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb284da-5d39-4f6d-a36e-1addb0ac7c1d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.270287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb284da-5d39-4f6d-a36e-1addb0ac7c1d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.279777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08068390-2aff-48e7-85ab-c1f2800425de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.280713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08068390-2aff-48e7-85ab-c1f2800425de admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.281043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08068390-2aff-48e7-85ab-c1f2800425de admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.281362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08068390-2aff-48e7-85ab-c1f2800425de admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/groups/faaff9292a464970adb868294f36a9d8/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.283321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08068390-2aff-48e7-85ab-c1f2800425de admin admin] RBAC: Authorizing `identity:create_grant(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b, group_id=faaff9292a464970adb868294f36a9d8, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:19.286101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08068390-2aff-48e7-85ab-c1f2800425de admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:19.312501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 144/284] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Jul 28 03:25:19 2021] PUT /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/groups/faaff9292a464970adb868294f36a9d8/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:19.455432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec293-892c-474b-b175-afcb1585cf16 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.455820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec293-892c-474b-b175-afcb1585cf16 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.456019 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec293-892c-474b-b175-afcb1585cf16 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.458087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 141/285] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:19.464832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1ac4-688e-461c-8bb4-5054ec274dc6 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.465423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1ac4-688e-461c-8bb4-5054ec274dc6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.465898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1ac4-688e-461c-8bb4-5054ec274dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.487947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f8bd1ac4-688e-461c-8bb4-5054ec274dc6 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:19.489127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f8bd1ac4-688e-461c-8bb4-5054ec274dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:19.570401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 145/286] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:19.595586 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec293-892c-474b-b175-afcb1585cf16 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.608089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec293-892c-474b-b175-afcb1585cf16 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.615150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74affcb5-7a75-45ae-98f1-497a5a5e76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.616781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74affcb5-7a75-45ae-98f1-497a5a5e76a1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.617370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74affcb5-7a75-45ae-98f1-497a5a5e76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.617840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74affcb5-7a75-45ae-98f1-497a5a5e76a1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.632365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74affcb5-7a75-45ae-98f1-497a5a5e76a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:19.642231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-74affcb5-7a75-45ae-98f1-497a5a5e76a1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:19.643879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 142/287] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:19.650652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1ac4-688e-461c-8bb4-5054ec274dc6 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.660645 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1ac4-688e-461c-8bb4-5054ec274dc6 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.665036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.665714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.665995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.666265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.667024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:19.667325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:19.668996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:19.679223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 146/288] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:19.686223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74affcb5-7a75-45ae-98f1-497a5a5e76a1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.700683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74affcb5-7a75-45ae-98f1-497a5a5e76a1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.707453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.708334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.708610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.708874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.711721 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:19.712761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:19.712761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:19.712761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:19.714200 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:19.715799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 143/289] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:19 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:19.721857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.736310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3a991-539b-45f9-ab9c-9b07c341c9f9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.745577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23128a-f0b8-44d7-9b59-03f9754d3005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.746444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23128a-f0b8-44d7-9b59-03f9754d3005 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.746720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23128a-f0b8-44d7-9b59-03f9754d3005 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.746994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23128a-f0b8-44d7-9b59-03f9754d3005 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.752496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23128a-f0b8-44d7-9b59-03f9754d3005 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:19.754567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23128a-f0b8-44d7-9b59-03f9754d3005 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:19.756295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 147/290] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:19 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:19.763460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:19.776688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb033eef-bb2b-414a-a06c-a50028689532 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:19.783567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f05611-76a9-44a2-9142-bc887c87856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:19.784474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f05611-76a9-44a2-9142-bc887c87856d admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.784755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f05611-76a9-44a2-9142-bc887c87856d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.785027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f05611-76a9-44a2-9142-bc887c87856d admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/groups/faaff9292a464970adb868294f36a9d8/roles/86c69e4b7605423ebcc1c4d6bc21c052` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.793097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f05611-76a9-44a2-9142-bc887c87856d admin admin] RBAC: Authorizing `identity:create_grant(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b, group_id=faaff9292a464970adb868294f36a9d8, role_id=86c69e4b7605423ebcc1c4d6bc21c052)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:19.795759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f05611-76a9-44a2-9142-bc887c87856d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:19.827626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 144/291] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Jul 28 03:25:19 2021] PUT /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b/groups/faaff9292a464970adb868294f36a9d8/roles/86c69e4b7605423ebcc1c4d6bc21c052 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:19.974153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c301-13c2-48fe-9c5d-4c324f8f2077 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.974533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c301-13c2-48fe-9c5d-4c324f8f2077 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.974718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c301-13c2-48fe-9c5d-4c324f8f2077 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:19.977201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 148/292] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:19.984066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45efb5-ebcc-4be3-90f2-12178a73948c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:19.984400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45efb5-ebcc-4be3-90f2-12178a73948c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:19.984627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45efb5-ebcc-4be3-90f2-12178a73948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:20.012815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ac45efb5-ebcc-4be3-90f2-12178a73948c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:20.014006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ac45efb5-ebcc-4be3-90f2-12178a73948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:20.092067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 145/293] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:20.120086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c301-13c2-48fe-9c5d-4c324f8f2077 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:20.133780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c301-13c2-48fe-9c5d-4c324f8f2077 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:20.138036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e96dc7-3388-4ba0-8600-69d4c0378c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:20.138878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96dc7-3388-4ba0-8600-69d4c0378c14 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:20.139165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96dc7-3388-4ba0-8600-69d4c0378c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:20.139440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96dc7-3388-4ba0-8600-69d4c0378c14 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:20.150824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e96dc7-3388-4ba0-8600-69d4c0378c14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:20.157794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-61e96dc7-3388-4ba0-8600-69d4c0378c14 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:20.159036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 149/294] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:20.165679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45efb5-ebcc-4be3-90f2-12178a73948c None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:20.174308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45efb5-ebcc-4be3-90f2-12178a73948c None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:20.179356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:20.180195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:20.180482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:20.180772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:20.181611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:20.181915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:20.183594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:20.196103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 146/295] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:20.202618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e96dc7-3388-4ba0-8600-69d4c0378c14 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:20.214358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e96dc7-3388-4ba0-8600-69d4c0378c14 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:20.218641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe8d0-36ae-4298-beb7-ae6e34277f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:20.219546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe8d0-36ae-4298-beb7-ae6e34277f5c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:20.219892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe8d0-36ae-4298-beb7-ae6e34277f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:20.220224 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe8d0-36ae-4298-beb7-ae6e34277f5c admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:20.221392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fe8d0-36ae-4298-beb7-ae6e34277f5c admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:20.223365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fe8d0-36ae-4298-beb7-ae6e34277f5c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:20.225001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 150/296] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:20 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:20.231272 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:20.242930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b618b6-b68a-4ed4-8ef1-961b50cf8239 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:20.247294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8fd2f-1e42-4237-b740-303c6779b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:20.248232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8fd2f-1e42-4237-b740-303c6779b2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:20.248567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8fd2f-1e42-4237-b740-303c6779b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:20.248845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8fd2f-1e42-4237-b740-303c6779b2e4 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:20.250043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8fd2f-1e42-4237-b740-303c6779b2e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:20.252240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8fd2f-1e42-4237-b740-303c6779b2e4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:20.253997 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 147/297] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:20 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:20.260549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe8d0-36ae-4298-beb7-ae6e34277f5c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:20.271194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe8d0-36ae-4298-beb7-ae6e34277f5c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:20.276157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc30b9-d05d-4b1d-9042-a1d733d1fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:20.277096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc30b9-d05d-4b1d-9042-a1d733d1fa97 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:20.277379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc30b9-d05d-4b1d-9042-a1d733d1fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:20.277704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc30b9-d05d-4b1d-9042-a1d733d1fa97 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f/groups/faaff9292a464970adb868294f36a9d8/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:20.279660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc30b9-d05d-4b1d-9042-a1d733d1fa97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6f764cee714a30baaf63707c28b80f, group_id=faaff9292a464970adb868294f36a9d8, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:20.282444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc30b9-d05d-4b1d-9042-a1d733d1fa97 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:20.312303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 151/298] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Jul 28 03:25:20 2021] PUT /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f/groups/faaff9292a464970adb868294f36a9d8/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:20.892699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1bbc-ab6a-4b2a-91d5-e1680c1cc9b9 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:20.893079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1bbc-ab6a-4b2a-91d5-e1680c1cc9b9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:20.893278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1bbc-ab6a-4b2a-91d5-e1680c1cc9b9 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:20.895049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 148/299] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:20.901324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e474-ee93-46d7-96e3-09c23ac886b2 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:20.901618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e474-ee93-46d7-96e3-09c23ac886b2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:20.901895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e474-ee93-46d7-96e3-09c23ac886b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:20.919474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-2fe1e474-ee93-46d7-96e3-09c23ac886b2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:20.920661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2fe1e474-ee93-46d7-96e3-09c23ac886b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:20.989347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 152/300] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:21.028219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1bbc-ab6a-4b2a-91d5-e1680c1cc9b9 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.040632 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1bbc-ab6a-4b2a-91d5-e1680c1cc9b9 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.044694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba785c-5217-446a-8da2-0703c4c5df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.045503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba785c-5217-446a-8da2-0703c4c5df41 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.045782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba785c-5217-446a-8da2-0703c4c5df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.046115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba785c-5217-446a-8da2-0703c4c5df41 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.061248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba785c-5217-446a-8da2-0703c4c5df41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:21.068457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-8aba785c-5217-446a-8da2-0703c4c5df41 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:21.069785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 149/301] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:21.076533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1e474-ee93-46d7-96e3-09c23ac886b2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.086133 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1e474-ee93-46d7-96e3-09c23ac886b2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.090822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.091526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.091834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.092111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.092949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:21.093254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:21.094905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:21.104875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 153/302] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:21.111554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba785c-5217-446a-8da2-0703c4c5df41 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.127745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba785c-5217-446a-8da2-0703c4c5df41 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.129557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9add1f-89bf-40d9-b450-44fcb6bf1b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.130491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9add1f-89bf-40d9-b450-44fcb6bf1b9b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.130821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9add1f-89bf-40d9-b450-44fcb6bf1b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.131097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9add1f-89bf-40d9-b450-44fcb6bf1b9b admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.132462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9add1f-89bf-40d9-b450-44fcb6bf1b9b admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:21.134529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9add1f-89bf-40d9-b450-44fcb6bf1b9b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:21.136552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 150/303] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:21 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:21.142470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.152799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee357db-1c62-48f1-b428-6d9b97100e04 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.157166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee12f6-4a74-45c4-a857-00fb0ca58cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.158025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee12f6-4a74-45c4-a857-00fb0ca58cde admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.158359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee12f6-4a74-45c4-a857-00fb0ca58cde admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.158633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee12f6-4a74-45c4-a857-00fb0ca58cde admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.159850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee12f6-4a74-45c4-a857-00fb0ca58cde admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:21.162011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee12f6-4a74-45c4-a857-00fb0ca58cde admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:21.171737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 154/304] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:21 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:21.174631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9add1f-89bf-40d9-b450-44fcb6bf1b9b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.186246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9add1f-89bf-40d9-b450-44fcb6bf1b9b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.190580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e03be-2683-4277-b709-58ce50c2bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.191527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e03be-2683-4277-b709-58ce50c2bb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.191812 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e03be-2683-4277-b709-58ce50c2bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.192088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e03be-2683-4277-b709-58ce50c2bb85 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f/groups/faaff9292a464970adb868294f36a9d8/roles/86c69e4b7605423ebcc1c4d6bc21c052` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.194357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e03be-2683-4277-b709-58ce50c2bb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6f764cee714a30baaf63707c28b80f, group_id=faaff9292a464970adb868294f36a9d8, role_id=86c69e4b7605423ebcc1c4d6bc21c052)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:21.197192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e03be-2683-4277-b709-58ce50c2bb85 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:21.222301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 151/305] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Jul 28 03:25:21 2021] PUT /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f/groups/faaff9292a464970adb868294f36a9d8/roles/86c69e4b7605423ebcc1c4d6bc21c052 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:21.226967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca3327-c446-49e8-9f70-2bde3e4a5c1f None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.227242 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca3327-c446-49e8-9f70-2bde3e4a5c1f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.227528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca3327-c446-49e8-9f70-2bde3e4a5c1f None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.229934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 155/306] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:21.236693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e289d8-ba94-47b8-bda2-81a3d0df640f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.237026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e289d8-ba94-47b8-bda2-81a3d0df640f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.237292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e289d8-ba94-47b8-bda2-81a3d0df640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.262011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-97e289d8-ba94-47b8-bda2-81a3d0df640f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:21.263191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-97e289d8-ba94-47b8-bda2-81a3d0df640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:21.342385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 152/307] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:21.371316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca3327-c446-49e8-9f70-2bde3e4a5c1f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.385783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca3327-c446-49e8-9f70-2bde3e4a5c1f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.392323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4cc5-bfac-4695-813a-2b87821d010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.393137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4cc5-bfac-4695-813a-2b87821d010a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.393419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4cc5-bfac-4695-813a-2b87821d010a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.393695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4cc5-bfac-4695-813a-2b87821d010a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.406914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4cc5-bfac-4695-813a-2b87821d010a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:21.414217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-e26c4cc5-bfac-4695-813a-2b87821d010a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:21.419818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 156/308] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:21.422209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e289d8-ba94-47b8-bda2-81a3d0df640f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.436798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e289d8-ba94-47b8-bda2-81a3d0df640f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.448399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.449407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.449890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.450383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.451338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:21.451917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:21.453737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:21.468089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 153/309] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:21.474374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4cc5-bfac-4695-813a-2b87821d010a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.484961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4cc5-bfac-4695-813a-2b87821d010a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.489146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1af10-24ba-498f-8625-8eb7947e8511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.490003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1af10-24ba-498f-8625-8eb7947e8511 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.490283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1af10-24ba-498f-8625-8eb7947e8511 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.490560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1af10-24ba-498f-8625-8eb7947e8511 admin admin] PATH_INFO: `/v3/groups/baee4808895f4dc7ad14cc5480c64f55` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.491779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1af10-24ba-498f-8625-8eb7947e8511 admin admin] RBAC: Authorizing `identity:get_group(group_id=baee4808895f4dc7ad14cc5480c64f55)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:21.493860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1af10-24ba-498f-8625-8eb7947e8511 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:21.495524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 157/310] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:21 2021] GET /identity/v3/groups/baee4808895f4dc7ad14cc5480c64f55 => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:21.501789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.517878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4be98-eae2-4ad1-9da4-47133d66cedb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.526112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea64f22-e78a-40ec-8f83-40466cba20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.527280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64f22-e78a-40ec-8f83-40466cba20aa admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.527783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64f22-e78a-40ec-8f83-40466cba20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.528257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64f22-e78a-40ec-8f83-40466cba20aa admin admin] PATH_INFO: `/v3/projects/a74500eac66c48568f2eb64dd512dfc6` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.532483 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea64f22-e78a-40ec-8f83-40466cba20aa admin admin] RBAC: Authorizing `identity:get_project(project_id=a74500eac66c48568f2eb64dd512dfc6)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:21.534506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea64f22-e78a-40ec-8f83-40466cba20aa admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:21.536381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 154/311] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:21 2021] GET /identity/v3/projects/a74500eac66c48568f2eb64dd512dfc6 => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:21.543311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1af10-24ba-498f-8625-8eb7947e8511 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:21.552724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1af10-24ba-498f-8625-8eb7947e8511 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:21.561875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208af90-2c2d-4ef6-a4be-7850fde4e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:21.562767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208af90-2c2d-4ef6-a4be-7850fde4e331 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:21.563044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208af90-2c2d-4ef6-a4be-7850fde4e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:21.563315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208af90-2c2d-4ef6-a4be-7850fde4e331 admin admin] PATH_INFO: `/v3/projects/a74500eac66c48568f2eb64dd512dfc6/groups/baee4808895f4dc7ad14cc5480c64f55/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:21.565177 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208af90-2c2d-4ef6-a4be-7850fde4e331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74500eac66c48568f2eb64dd512dfc6, group_id=baee4808895f4dc7ad14cc5480c64f55, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:21.567863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208af90-2c2d-4ef6-a4be-7850fde4e331 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:21.595105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 158/312] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Jul 28 03:25:21 2021] PUT /identity/v3/projects/a74500eac66c48568f2eb64dd512dfc6/groups/baee4808895f4dc7ad14cc5480c64f55/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:22.076076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aeb0a-aa92-48f9-af5f-3a217deec4d3 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:22.076775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aeb0a-aa92-48f9-af5f-3a217deec4d3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:22.077260 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aeb0a-aa92-48f9-af5f-3a217deec4d3 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:22.079263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 155/313] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:22.087676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a45f-c868-457a-a1d5-6675b790378f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:22.087985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a45f-c868-457a-a1d5-6675b790378f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:22.088509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a45f-c868-457a-a1d5-6675b790378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:22.117069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b149a45f-c868-457a-a1d5-6675b790378f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:22.118250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b149a45f-c868-457a-a1d5-6675b790378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:22.189364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 159/314] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:22.218796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aeb0a-aa92-48f9-af5f-3a217deec4d3 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:22.240380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aeb0a-aa92-48f9-af5f-3a217deec4d3 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:22.245082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953587-0443-497a-91f1-c71d37317bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:22.246120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953587-0443-497a-91f1-c71d37317bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:22.246604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953587-0443-497a-91f1-c71d37317bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:22.247077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953587-0443-497a-91f1-c71d37317bd8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:22.269056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e953587-0443-497a-91f1-c71d37317bd8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:22.276233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-9e953587-0443-497a-91f1-c71d37317bd8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:22.279572 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 156/315] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:22.285260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149a45f-c868-457a-a1d5-6675b790378f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:22.302483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149a45f-c868-457a-a1d5-6675b790378f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:22.321198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:22.321935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:22.322216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:22.322597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:22.323350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] RBAC: Adding query filter params (name=member) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:22.323648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:22.329360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:22.347318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 160/316] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:22.354606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953587-0443-497a-91f1-c71d37317bd8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:22.369535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953587-0443-497a-91f1-c71d37317bd8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:22.384334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072c50e-c435-4db4-ad26-765f1f56dd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:22.385375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072c50e-c435-4db4-ad26-765f1f56dd99 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:22.385860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072c50e-c435-4db4-ad26-765f1f56dd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:22.386334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072c50e-c435-4db4-ad26-765f1f56dd99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:22.394756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072c50e-c435-4db4-ad26-765f1f56dd99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:22.396785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072c50e-c435-4db4-ad26-765f1f56dd99 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:22.406729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 157/317] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:22.415103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:22.426937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ceb13-ce2b-4869-a6c7-8f07b9d0808b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:22.435601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417d05c-7c0f-4c87-b2af-aa5f70df7647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:22.436449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417d05c-7c0f-4c87-b2af-aa5f70df7647 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:22.436726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417d05c-7c0f-4c87-b2af-aa5f70df7647 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:22.436996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417d05c-7c0f-4c87-b2af-aa5f70df7647 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:22.440429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417d05c-7c0f-4c87-b2af-aa5f70df7647 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:22.442485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417d05c-7c0f-4c87-b2af-aa5f70df7647 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:22.444580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 161/318] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:22 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:22.450241 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072c50e-c435-4db4-ad26-765f1f56dd99 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:22.461254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072c50e-c435-4db4-ad26-765f1f56dd99 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:22.467586 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d9c44-9903-45ee-a077-d18eae140f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:22.468775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d9c44-9903-45ee-a077-d18eae140f74 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:22.469273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d9c44-9903-45ee-a077-d18eae140f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:22.469761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d9c44-9903-45ee-a077-d18eae140f74 admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:22.471512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d9c44-9903-45ee-a077-d18eae140f74 admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:22.473689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d9c44-9903-45ee-a077-d18eae140f74 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:22.475992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 158/319] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:22 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:22.482111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417d05c-7c0f-4c87-b2af-aa5f70df7647 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:22.496801 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417d05c-7c0f-4c87-b2af-aa5f70df7647 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:22.503470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a846ee2-9892-4c1d-9c38-0e6641dbd32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:22.504154 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a846ee2-9892-4c1d-9c38-0e6641dbd32c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:22.504422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a846ee2-9892-4c1d-9c38-0e6641dbd32c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:22.504695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a846ee2-9892-4c1d-9c38-0e6641dbd32c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:22.505521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a846ee2-9892-4c1d-9c38-0e6641dbd32c admin admin] RBAC: Adding query filter params (group.id=faaff9292a464970adb868294f36a9d8, role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:22.505833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a846ee2-9892-4c1d-9c38-0e6641dbd32c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:22.508847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a846ee2-9892-4c1d-9c38-0e6641dbd32c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:22.520657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 162/320] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:22 2021] GET /identity/v3/role_assignments?group.id=faaff9292a464970adb868294f36a9d8&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.076018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22813637-cb42-43ee-9208-6485f55bca1c None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.076384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22813637-cb42-43ee-9208-6485f55bca1c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.076601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22813637-cb42-43ee-9208-6485f55bca1c None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.078960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 159/321] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:23.085625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39109d5-ad3c-4d85-8c15-793e1beb7c46 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.085949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39109d5-ad3c-4d85-8c15-793e1beb7c46 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.086191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39109d5-ad3c-4d85-8c15-793e1beb7c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.109710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f39109d5-ad3c-4d85-8c15-793e1beb7c46 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:23.110876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f39109d5-ad3c-4d85-8c15-793e1beb7c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:23.122493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:23.149135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22813637-cb42-43ee-9208-6485f55bca1c None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.161893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22813637-cb42-43ee-9208-6485f55bca1c None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.167471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ba733-0836-42c9-97e0-da63a7b0e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.171938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba733-0836-42c9-97e0-da63a7b0e1cd admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.171938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba733-0836-42c9-97e0-da63a7b0e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.171938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba733-0836-42c9-97e0-da63a7b0e1cd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.187441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ba733-0836-42c9-97e0-da63a7b0e1cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:23.195736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-0a5ba733-0836-42c9-97e0-da63a7b0e1cd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:23.197013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 160/323] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:23.203849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39109d5-ad3c-4d85-8c15-793e1beb7c46 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.214301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39109d5-ad3c-4d85-8c15-793e1beb7c46 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.221364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.222036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.222317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.222586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.223336 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:23.223640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.225271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.237247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 164/324] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.242994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342dda9-84f8-4687-809b-7fb462793b56 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.243433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342dda9-84f8-4687-809b-7fb462793b56 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.243525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342dda9-84f8-4687-809b-7fb462793b56 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.245529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 161/325] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:23.246469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.253318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8b23-8d7f-473a-9fee-53ec223ecaaf None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.253318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8b23-8d7f-473a-9fee-53ec223ecaaf None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.253318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8b23-8d7f-473a-9fee-53ec223ecaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.262768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b50e7-2d73-4c08-b059-4b67be6e8a50 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.267138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee24dd-7710-4354-8fe0-8aa1d4e10722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.267937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee24dd-7710-4354-8fe0-8aa1d4e10722 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.268994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee24dd-7710-4354-8fe0-8aa1d4e10722 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.269266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee24dd-7710-4354-8fe0-8aa1d4e10722 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.278665 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9fdd8b23-8d7f-473a-9fee-53ec223ecaaf None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:23.280187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9fdd8b23-8d7f-473a-9fee-53ec223ecaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:23.280870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee24dd-7710-4354-8fe0-8aa1d4e10722 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.282654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee24dd-7710-4354-8fe0-8aa1d4e10722 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.292874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 162/326] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:23.294136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 165/327] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:23.300647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8b23-8d7f-473a-9fee-53ec223ecaaf None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.310973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8b23-8d7f-473a-9fee-53ec223ecaaf None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.315328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cdef7-b571-4e94-9a0b-60f8e1ffc865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.316245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cdef7-b571-4e94-9a0b-60f8e1ffc865 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.316520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cdef7-b571-4e94-9a0b-60f8e1ffc865 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.316787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cdef7-b571-4e94-9a0b-60f8e1ffc865 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.317944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cdef7-b571-4e94-9a0b-60f8e1ffc865 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.320921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cdef7-b571-4e94-9a0b-60f8e1ffc865 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.322642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 163/328] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.323348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee24dd-7710-4354-8fe0-8aa1d4e10722 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.329618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cdef7-b571-4e94-9a0b-60f8e1ffc865 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.335810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee24dd-7710-4354-8fe0-8aa1d4e10722 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.340691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4578-b1aa-4801-8720-4557115ff30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.340837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cdef7-b571-4e94-9a0b-60f8e1ffc865 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.341871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4578-b1aa-4801-8720-4557115ff30f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.342324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4578-b1aa-4801-8720-4557115ff30f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.342824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4578-b1aa-4801-8720-4557115ff30f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.346227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0ce4-9216-40e0-8b5c-1a5d58d17600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.347405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0ce4-9216-40e0-8b5c-1a5d58d17600 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.347687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0ce4-9216-40e0-8b5c-1a5d58d17600 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.347988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0ce4-9216-40e0-8b5c-1a5d58d17600 admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.349129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0ce4-9216-40e0-8b5c-1a5d58d17600 admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.351398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0ce4-9216-40e0-8b5c-1a5d58d17600 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.353604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 164/329] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:23.360069 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0ce4-9216-40e0-8b5c-1a5d58d17600 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.362673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4578-b1aa-4801-8720-4557115ff30f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:23.370848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0ce4-9216-40e0-8b5c-1a5d58d17600 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.373460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-39cb4578-b1aa-4801-8720-4557115ff30f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:25:23.375258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 166/330] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:23.377633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.377759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.378089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.378364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.379195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] RBAC: Adding query filter params (group.id=faaff9292a464970adb868294f36a9d8, role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:23.379507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.381403 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.382837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4578-b1aa-4801-8720-4557115ff30f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.390419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 165/331] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/role_assignments?group.id=faaff9292a464970adb868294f36a9d8&scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.399803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4578-b1aa-4801-8720-4557115ff30f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.406249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.407012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.407287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.407616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.408424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:23.408793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.410571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.426287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 167/332] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.427970 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.439508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f513d2-9dc2-4321-8902-b911f0d781c1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.451558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad345b-c85d-429d-bd67-2ad2e6f17858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.452327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad345b-c85d-429d-bd67-2ad2e6f17858 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.452712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad345b-c85d-429d-bd67-2ad2e6f17858 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.452994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad345b-c85d-429d-bd67-2ad2e6f17858 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.466073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad345b-c85d-429d-bd67-2ad2e6f17858 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.467995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad345b-c85d-429d-bd67-2ad2e6f17858 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.478257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 166/333] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:23.484808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.495420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdfd0-9b7d-410a-9549-9fe8d1cbcb98 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.499778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c8feb-ba4e-46ea-ad39-0d5d95a6fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.500724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8feb-ba4e-46ea-ad39-0d5d95a6fa7a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.501004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8feb-ba4e-46ea-ad39-0d5d95a6fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.501329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8feb-ba4e-46ea-ad39-0d5d95a6fa7a admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.502594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c8feb-ba4e-46ea-ad39-0d5d95a6fa7a admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.505010 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c8feb-ba4e-46ea-ad39-0d5d95a6fa7a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.507450 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 168/334] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.514190 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad345b-c85d-429d-bd67-2ad2e6f17858 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.524744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad345b-c85d-429d-bd67-2ad2e6f17858 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.529102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7033d50-fda1-42f6-a3d0-c62962f6657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.530060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033d50-fda1-42f6-a3d0-c62962f6657e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.530343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033d50-fda1-42f6-a3d0-c62962f6657e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.530615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033d50-fda1-42f6-a3d0-c62962f6657e admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.531881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7033d50-fda1-42f6-a3d0-c62962f6657e admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.533907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7033d50-fda1-42f6-a3d0-c62962f6657e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.539995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 167/335] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.543310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c8feb-ba4e-46ea-ad39-0d5d95a6fa7a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.553530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c8feb-ba4e-46ea-ad39-0d5d95a6fa7a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.558631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f5181-06df-4d4f-ba85-7b2be5194dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.559294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f5181-06df-4d4f-ba85-7b2be5194dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.559629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f5181-06df-4d4f-ba85-7b2be5194dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.559936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f5181-06df-4d4f-ba85-7b2be5194dd0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.560843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f5181-06df-4d4f-ba85-7b2be5194dd0 admin admin] RBAC: Adding query filter params (group.id=faaff9292a464970adb868294f36a9d8, role.id=ed504008bcef4191855e83ad32f4c9a4, scope.project.id=3c6f764cee714a30baaf63707c28b80f) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:23.561155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f5181-06df-4d4f-ba85-7b2be5194dd0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.563171 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f5181-06df-4d4f-ba85-7b2be5194dd0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.570512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 169/336] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/role_assignments?group.id=faaff9292a464970adb868294f36a9d8&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=ed504008bcef4191855e83ad32f4c9a4 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.794759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce71100-b26c-4028-b49b-e39126f5b96e None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.795189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce71100-b26c-4028-b49b-e39126f5b96e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.795377 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce71100-b26c-4028-b49b-e39126f5b96e None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.797444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 168/337] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:23.805043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a4e43-23af-48f1-a4aa-641e969e1acd None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.805619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a4e43-23af-48f1-a4aa-641e969e1acd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.806116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a4e43-23af-48f1-a4aa-641e969e1acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.825388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-784a4e43-23af-48f1-a4aa-641e969e1acd None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:23.826542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-784a4e43-23af-48f1-a4aa-641e969e1acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:23.835372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 170/338] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:23.860267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce71100-b26c-4028-b49b-e39126f5b96e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.872651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce71100-b26c-4028-b49b-e39126f5b96e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.876698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f49caa-b596-4a0e-9770-3d63367c6479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.877505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49caa-b596-4a0e-9770-3d63367c6479 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.877786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49caa-b596-4a0e-9770-3d63367c6479 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.878061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49caa-b596-4a0e-9770-3d63367c6479 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.888658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f49caa-b596-4a0e-9770-3d63367c6479 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:23.895897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-f5f49caa-b596-4a0e-9770-3d63367c6479 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:23.897086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 169/339] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:23.904476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a4e43-23af-48f1-a4aa-641e969e1acd None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.913877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a4e43-23af-48f1-a4aa-641e969e1acd None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.918267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.918947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.919225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.919499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.920282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:23.920589 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.922186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.932249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 171/340] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:23.939087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f49caa-b596-4a0e-9770-3d63367c6479 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.950030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f49caa-b596-4a0e-9770-3d63367c6479 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.954293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6d1c0-e97c-41b5-b6cd-fad224c146d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.954948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d1c0-e97c-41b5-b6cd-fad224c146d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.955231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d1c0-e97c-41b5-b6cd-fad224c146d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.955509 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d1c0-e97c-41b5-b6cd-fad224c146d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.964298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6d1c0-e97c-41b5-b6cd-fad224c146d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:23.966069 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6d1c0-e97c-41b5-b6cd-fad224c146d4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:23.974496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 170/341] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:23.981692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:23.991979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681f262-d89e-441d-9244-5ac909be0918 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:23.996692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d23ab-7c6d-41f4-8c3d-6d5e2aed97a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:23.997560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d23ab-7c6d-41f4-8c3d-6d5e2aed97a9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:23.997892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d23ab-7c6d-41f4-8c3d-6d5e2aed97a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:23.998176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d23ab-7c6d-41f4-8c3d-6d5e2aed97a9 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:23.999324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d23ab-7c6d-41f4-8c3d-6d5e2aed97a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:24.001436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d23ab-7c6d-41f4-8c3d-6d5e2aed97a9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:24.003486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 172/342] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:23 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:24.010106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6d1c0-e97c-41b5-b6cd-fad224c146d4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:24.018527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6d1c0-e97c-41b5-b6cd-fad224c146d4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:24.022961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbca77-7812-4bb9-97e3-26ae7b0da504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:24.024023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbca77-7812-4bb9-97e3-26ae7b0da504 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.024309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbca77-7812-4bb9-97e3-26ae7b0da504 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.024583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbca77-7812-4bb9-97e3-26ae7b0da504 admin admin] PATH_INFO: `/v3/groups/faaff9292a464970adb868294f36a9d8` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.025716 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbca77-7812-4bb9-97e3-26ae7b0da504 admin admin] RBAC: Authorizing `identity:get_group(group_id=faaff9292a464970adb868294f36a9d8)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:24.027633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbca77-7812-4bb9-97e3-26ae7b0da504 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:24.029630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 171/343] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:24 2021] GET /identity/v3/groups/faaff9292a464970adb868294f36a9d8 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:24.035858 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d23ab-7c6d-41f4-8c3d-6d5e2aed97a9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:24.044975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d23ab-7c6d-41f4-8c3d-6d5e2aed97a9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:24.048931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984e0e8-743f-4e76-9c86-50fed064e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:24.049574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e0e8-743f-4e76-9c86-50fed064e52c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.049850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e0e8-743f-4e76-9c86-50fed064e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.050124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e0e8-743f-4e76-9c86-50fed064e52c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.050941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e0e8-743f-4e76-9c86-50fed064e52c admin admin] RBAC: Adding query filter params (group.id=faaff9292a464970adb868294f36a9d8, role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=3c6f764cee714a30baaf63707c28b80f) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:24.051250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e0e8-743f-4e76-9c86-50fed064e52c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:24.053112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e0e8-743f-4e76-9c86-50fed064e52c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:24.059885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 173/344] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:24 2021] GET /identity/v3/role_assignments?group.id=faaff9292a464970adb868294f36a9d8&scope.project.id=3c6f764cee714a30baaf63707c28b80f&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:24.347634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87167-b921-4852-afe4-7197536c1266 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.348154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87167-b921-4852-afe4-7197536c1266 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.348239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87167-b921-4852-afe4-7197536c1266 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.349995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 172/345] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:24.356480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2cc8-c19e-4421-a277-006dd03c576e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.356896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2cc8-c19e-4421-a277-006dd03c576e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.357035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2cc8-c19e-4421-a277-006dd03c576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.374850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8d1f2cc8-c19e-4421-a277-006dd03c576e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:24.376055 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8d1f2cc8-c19e-4421-a277-006dd03c576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:24.383134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 174/346] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:24.407463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87167-b921-4852-afe4-7197536c1266 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:24.419383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87167-b921-4852-afe4-7197536c1266 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:24.423267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5e9a3-2c17-4abb-af9d-e52c7a564488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:24.424119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e9a3-2c17-4abb-af9d-e52c7a564488 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.424404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e9a3-2c17-4abb-af9d-e52c7a564488 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.424675 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e9a3-2c17-4abb-af9d-e52c7a564488 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.435124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5e9a3-2c17-4abb-af9d-e52c7a564488 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:24.441741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-c6a5e9a3-2c17-4abb-af9d-e52c7a564488 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:24.442868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 173/347] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:24.449997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2cc8-c19e-4421-a277-006dd03c576e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:24.458375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2cc8-c19e-4421-a277-006dd03c576e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:24.462656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:24.463562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.463887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.464166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.464910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:24.465216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:24.466816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:24.474790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 175/348] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:24.481220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5e9a3-2c17-4abb-af9d-e52c7a564488 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:24.489911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5e9a3-2c17-4abb-af9d-e52c7a564488 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:24.494824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6094bd-73b6-426c-89c1-c4e89859bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:24.495431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6094bd-73b6-426c-89c1-c4e89859bbae admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.495734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6094bd-73b6-426c-89c1-c4e89859bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.496011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6094bd-73b6-426c-89c1-c4e89859bbae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.503650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6094bd-73b6-426c-89c1-c4e89859bbae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:24.505405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6094bd-73b6-426c-89c1-c4e89859bbae admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:24.513650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 174/349] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:24.519310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:24.527983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46c02-8b32-49e4-8bd9-845d0cd4bb96 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:24.532008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fd66-81f9-457b-9d17-0e4c9c5f81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:24.532833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fd66-81f9-457b-9d17-0e4c9c5f81cf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.533115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fd66-81f9-457b-9d17-0e4c9c5f81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.533390 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fd66-81f9-457b-9d17-0e4c9c5f81cf admin admin] PATH_INFO: `/v3/projects/a74500eac66c48568f2eb64dd512dfc6` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.534898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07fd66-81f9-457b-9d17-0e4c9c5f81cf admin admin] RBAC: Authorizing `identity:get_project(project_id=a74500eac66c48568f2eb64dd512dfc6)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:24.536696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07fd66-81f9-457b-9d17-0e4c9c5f81cf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:24.538756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 176/350] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:25:24 2021] GET /identity/v3/projects/a74500eac66c48568f2eb64dd512dfc6 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:24.544126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6094bd-73b6-426c-89c1-c4e89859bbae admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:24.551899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6094bd-73b6-426c-89c1-c4e89859bbae admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:24.556655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15103e7e-0dce-431c-93ed-a03287aac60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:24.557445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103e7e-0dce-431c-93ed-a03287aac60b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.557727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103e7e-0dce-431c-93ed-a03287aac60b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.557996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103e7e-0dce-431c-93ed-a03287aac60b admin admin] PATH_INFO: `/v3/groups/baee4808895f4dc7ad14cc5480c64f55` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.559103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15103e7e-0dce-431c-93ed-a03287aac60b admin admin] RBAC: Authorizing `identity:get_group(group_id=baee4808895f4dc7ad14cc5480c64f55)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:24.560992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15103e7e-0dce-431c-93ed-a03287aac60b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:24.562474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 175/351] 10.222.0.16 () {56 vars in 1202 bytes} [Wed Jul 28 03:25:24 2021] GET /identity/v3/groups/baee4808895f4dc7ad14cc5480c64f55 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:24.568343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fd66-81f9-457b-9d17-0e4c9c5f81cf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:24.576933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fd66-81f9-457b-9d17-0e4c9c5f81cf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:24.580990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708da89c-7ab9-4517-aac2-e64d8a81659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:24.581596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708da89c-7ab9-4517-aac2-e64d8a81659c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:24.581879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708da89c-7ab9-4517-aac2-e64d8a81659c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:24.582155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708da89c-7ab9-4517-aac2-e64d8a81659c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:24.582964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708da89c-7ab9-4517-aac2-e64d8a81659c admin admin] RBAC: Adding query filter params (group.id=baee4808895f4dc7ad14cc5480c64f55, role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=a74500eac66c48568f2eb64dd512dfc6) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:24.583273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708da89c-7ab9-4517-aac2-e64d8a81659c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:24.585148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708da89c-7ab9-4517-aac2-e64d8a81659c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:24.590902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 177/352] 10.222.0.16 () {56 vars in 1398 bytes} [Wed Jul 28 03:25:24 2021] GET /identity/v3/role_assignments?group.id=baee4808895f4dc7ad14cc5480c64f55&scope.project.id=a74500eac66c48568f2eb64dd512dfc6&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:27.078243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b88f-c33a-4164-962d-73e74ba91f39 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.078757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b88f-c33a-4164-962d-73e74ba91f39 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.078833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b88f-c33a-4164-962d-73e74ba91f39 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.080868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 176/353] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:27.087650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1662f-f516-4876-aced-371cec78a86f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.088134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1662f-f516-4876-aced-371cec78a86f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.088564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1662f-f516-4876-aced-371cec78a86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.109739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-7dd1662f-f516-4876-aced-371cec78a86f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:27.110902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7dd1662f-f516-4876-aced-371cec78a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:27.123480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 178/354] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:27.179178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567b88f-c33a-4164-962d-73e74ba91f39 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:27.196807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567b88f-c33a-4164-962d-73e74ba91f39 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:27.201037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:27.201833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.202111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.202385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.218318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:27.220207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:27.240303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:27.242476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 177/355] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:27.249062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1662f-f516-4876-aced-371cec78a86f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:27.258441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1662f-f516-4876-aced-371cec78a86f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:27.268328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4dc1-f72e-4af1-9648-d9a1a7f0194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:27.269001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4dc1-f72e-4af1-9648-d9a1a7f0194c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.269283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4dc1-f72e-4af1-9648-d9a1a7f0194c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.269564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4dc1-f72e-4af1-9648-d9a1a7f0194c admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.270299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4dc1-f72e-4af1-9648-d9a1a7f0194c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:27.270602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4dc1-f72e-4af1-9648-d9a1a7f0194c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:27.271629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-870f4dc1-f72e-4af1-9648-d9a1a7f0194c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:27.271629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:27.271629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:27.272581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4dc1-f72e-4af1-9648-d9a1a7f0194c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:27.296081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 179/356] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:27.302182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:27.313647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc13596-2027-454d-a35b-b7bf9907a3ee admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:27.319896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8574-1da8-4fae-81cd-e6acaa2c404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:27.320576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8574-1da8-4fae-81cd-e6acaa2c404a admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.320861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8574-1da8-4fae-81cd-e6acaa2c404a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.321136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8574-1da8-4fae-81cd-e6acaa2c404a admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.321860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8574-1da8-4fae-81cd-e6acaa2c404a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:27.323802 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8574-1da8-4fae-81cd-e6acaa2c404a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:27.358593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 178/357] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:25:27 2021] POST /identity/v3/users => generated 246 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:27.641138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448c1e4-0072-453e-95eb-61d25e3f272e None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.641477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448c1e4-0072-453e-95eb-61d25e3f272e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.641648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448c1e4-0072-453e-95eb-61d25e3f272e None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.643385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 180/358] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:27.651300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722fc8-a9ad-445d-8667-7cdf9b5877fa None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.651615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722fc8-a9ad-445d-8667-7cdf9b5877fa None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.651888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722fc8-a9ad-445d-8667-7cdf9b5877fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.673153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-bd722fc8-a9ad-445d-8667-7cdf9b5877fa None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:27.674317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bd722fc8-a9ad-445d-8667-7cdf9b5877fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:27.684030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 179/359] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:27.711288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448c1e4-0072-453e-95eb-61d25e3f272e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:27.730203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448c1e4-0072-453e-95eb-61d25e3f272e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:27.736363 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:27.737163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.737443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.737710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.750525 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:27.752442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:27.773704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:27.779875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 181/360] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:27.782886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd722fc8-a9ad-445d-8667-7cdf9b5877fa None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:27.792978 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd722fc8-a9ad-445d-8667-7cdf9b5877fa None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:27.799353 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b861a3-bf35-43f3-8c6e-5ce0ad47e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:27.800075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b861a3-bf35-43f3-8c6e-5ce0ad47e2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.800351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b861a3-bf35-43f3-8c6e-5ce0ad47e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.800622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b861a3-bf35-43f3-8c6e-5ce0ad47e2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.801364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b861a3-bf35-43f3-8c6e-5ce0ad47e2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:27.801667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b861a3-bf35-43f3-8c6e-5ce0ad47e2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:27.803346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b861a3-bf35-43f3-8c6e-5ce0ad47e2b5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:27.821151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 180/361] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:27.827367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:27.838776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56132608-ca33-45f3-a1a5-c5038658dde5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:27.844927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a555a-f28e-4824-ac98-85899ce041ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:27.845644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a555a-f28e-4824-ac98-85899ce041ce admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.845922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a555a-f28e-4824-ac98-85899ce041ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.846192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a555a-f28e-4824-ac98-85899ce041ce admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.846943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a555a-f28e-4824-ac98-85899ce041ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:27.848948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a555a-f28e-4824-ac98-85899ce041ce admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:27.863051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e08adb-de1d-416d-8c80-170fb7eb926a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.863331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e08adb-de1d-416d-8c80-170fb7eb926a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.863597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e08adb-de1d-416d-8c80-170fb7eb926a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.865934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 181/362] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:27.874707 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a82b5-2ed4-4a54-adde-f476d1c770b4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.875032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a82b5-2ed4-4a54-adde-f476d1c770b4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.875306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a82b5-2ed4-4a54-adde-f476d1c770b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.880749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 182/363] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:25:27 2021] POST /identity/v3/users => generated 248 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:27.898837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3c0a82b5-2ed4-4a54-adde-f476d1c770b4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:27.900112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3c0a82b5-2ed4-4a54-adde-f476d1c770b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:27.908028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 182/364] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:27.934506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a555a-f28e-4824-ac98-85899ce041ce admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:27.944560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a555a-f28e-4824-ac98-85899ce041ce admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:27.949284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:27.950150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:27.950434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:27.950706 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:27.965745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:27.967611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:27.986140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:27.990476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 183/365] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:27.994740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a82b5-2ed4-4a54-adde-f476d1c770b4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:28.003543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a82b5-2ed4-4a54-adde-f476d1c770b4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:28.008841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6b1d2-4bff-4d44-8f24-5ffba7630c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:28.009509 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b1d2-4bff-4d44-8f24-5ffba7630c0b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.009840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b1d2-4bff-4d44-8f24-5ffba7630c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.010116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b1d2-4bff-4d44-8f24-5ffba7630c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.010891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6b1d2-4bff-4d44-8f24-5ffba7630c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:28.011192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6b1d2-4bff-4d44-8f24-5ffba7630c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:28.012881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6b1d2-4bff-4d44-8f24-5ffba7630c0b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:28.034084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 183/366] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:28.046663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:28.056001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29d26b-baaa-4249-849f-d94599ba8448 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:28.067068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d98678-a993-49ba-9b67-a7d76752c863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:28.068210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d98678-a993-49ba-9b67-a7d76752c863 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.068726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d98678-a993-49ba-9b67-a7d76752c863 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.069747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d98678-a993-49ba-9b67-a7d76752c863 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.070803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d98678-a993-49ba-9b67-a7d76752c863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:28.073176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d98678-a993-49ba-9b67-a7d76752c863 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:28.110152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 184/367] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:25:28 2021] POST /identity/v3/users => generated 248 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:28.137610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c648-e912-45f8-bd47-26aea7b9540a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.138112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c648-e912-45f8-bd47-26aea7b9540a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.138186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c648-e912-45f8-bd47-26aea7b9540a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.140362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 184/368] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:28.146491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5f2ff-d221-436b-bdc6-a49ecb1a98e9 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.147180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5f2ff-d221-436b-bdc6-a49ecb1a98e9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.148179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5f2ff-d221-436b-bdc6-a49ecb1a98e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.176306 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-82b5f2ff-d221-436b-bdc6-a49ecb1a98e9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:28.177866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-82b5f2ff-d221-436b-bdc6-a49ecb1a98e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:28.189757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 185/369] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:28.216318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5c648-e912-45f8-bd47-26aea7b9540a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:28.230672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5c648-e912-45f8-bd47-26aea7b9540a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:28.237574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:28.238377 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.238702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.238978 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.252662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:28.254558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:28.273496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:28.276964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 185/370] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:28.282436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5f2ff-d221-436b-bdc6-a49ecb1a98e9 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:28.295019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5f2ff-d221-436b-bdc6-a49ecb1a98e9 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:28.303439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85924adb-f62e-445e-a89d-e6fbf75f91f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:28.305049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85924adb-f62e-445e-a89d-e6fbf75f91f4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.305342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85924adb-f62e-445e-a89d-e6fbf75f91f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.305623 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85924adb-f62e-445e-a89d-e6fbf75f91f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.306357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85924adb-f62e-445e-a89d-e6fbf75f91f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:28.306664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85924adb-f62e-445e-a89d-e6fbf75f91f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:28.308372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85924adb-f62e-445e-a89d-e6fbf75f91f4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:28.322169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 186/371] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:28.328011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:28.338195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8081-cb13-4c72-ad41-aeff088b6f19 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:28.343051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38fe90-57b1-48f9-a9d6-d3f3abd9d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:28.344026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38fe90-57b1-48f9-a9d6-d3f3abd9d5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.344469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38fe90-57b1-48f9-a9d6-d3f3abd9d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.344893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38fe90-57b1-48f9-a9d6-d3f3abd9d5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.345745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38fe90-57b1-48f9-a9d6-d3f3abd9d5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:28.347850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38fe90-57b1-48f9-a9d6-d3f3abd9d5d3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:28.379408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 186/372] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:25:28 2021] POST /identity/v3/users => generated 249 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:28.819789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7195c6-b0d0-4b97-88a0-c3b444b64102 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.820249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7195c6-b0d0-4b97-88a0-c3b444b64102 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.820527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7195c6-b0d0-4b97-88a0-c3b444b64102 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.822552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 187/373] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:28.828569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b99db-9ca0-417b-afe4-8646841acfcc None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.828857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b99db-9ca0-417b-afe4-8646841acfcc None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.829130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b99db-9ca0-417b-afe4-8646841acfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.851292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-7c0b99db-9ca0-417b-afe4-8646841acfcc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:28.852462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7c0b99db-9ca0-417b-afe4-8646841acfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:28.862379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 187/374] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:28.895273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7195c6-b0d0-4b97-88a0-c3b444b64102 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:28.910368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7195c6-b0d0-4b97-88a0-c3b444b64102 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:28.915078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:28.916323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.916810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.917372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:28.918389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:28.920492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:28.936968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.sql.core [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 03:25:28.936968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 03:25:28.936968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [parameters: {'id': 'd49e014c17b0439ea55562e158bfa338', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 03:25:28.936968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=72579) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 03:25:28.962393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 03:25:28.964769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 188/375] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:25:28 2021] POST /identity/v3/roles => generated 144 bytes in 70 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:28.971407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b99db-9ca0-417b-afe4-8646841acfcc None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:28.980546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b99db-9ca0-417b-afe4-8646841acfcc None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:28.988301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc623bc-0f59-4bee-bb05-d4ac8c0da2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:28.989424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc623bc-0f59-4bee-bb05-d4ac8c0da2ce admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:28.989951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc623bc-0f59-4bee-bb05-d4ac8c0da2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:28.990425 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc623bc-0f59-4bee-bb05-d4ac8c0da2ce admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:29.005817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc623bc-0f59-4bee-bb05-d4ac8c0da2ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:29.013987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-bfc623bc-0f59-4bee-bb05-d4ac8c0da2ce admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:25:29.015681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 188/376] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:29.022973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:29.034467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6373e-9d65-49aa-bda2-3629e55aec31 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:29.043395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf44696-9d4c-4e52-a4b2-80360328bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:29.044097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf44696-9d4c-4e52-a4b2-80360328bc5b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:29.044373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf44696-9d4c-4e52-a4b2-80360328bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:29.044641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf44696-9d4c-4e52-a4b2-80360328bc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:29.045502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf44696-9d4c-4e52-a4b2-80360328bc5b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:29.045806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf44696-9d4c-4e52-a4b2-80360328bc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:29.047520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf44696-9d4c-4e52-a4b2-80360328bc5b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:29.061547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 189/377] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:30.228820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16812cbc-152e-4e47-ad8a-c28a495c1be2 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.229359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16812cbc-152e-4e47-ad8a-c28a495c1be2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.229359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16812cbc-152e-4e47-ad8a-c28a495c1be2 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.231384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 189/378] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:30.236910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb27b-e1ea-4549-b08f-2adfb5fce610 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.237376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb27b-e1ea-4549-b08f-2adfb5fce610 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.237535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb27b-e1ea-4549-b08f-2adfb5fce610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.264619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ec3bb27b-e1ea-4549-b08f-2adfb5fce610 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:30.265795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ec3bb27b-e1ea-4549-b08f-2adfb5fce610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:30.273773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 190/379] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:30.310724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16812cbc-152e-4e47-ad8a-c28a495c1be2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.325254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16812cbc-152e-4e47-ad8a-c28a495c1be2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.332784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250adf64-06fb-41a9-9f79-3b444f5045e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.333575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adf64-06fb-41a9-9f79-3b444f5045e9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.333853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adf64-06fb-41a9-9f79-3b444f5045e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.334119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adf64-06fb-41a9-9f79-3b444f5045e9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.349605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250adf64-06fb-41a9-9f79-3b444f5045e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:30.356935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-250adf64-06fb-41a9-9f79-3b444f5045e9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:30.358452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 190/380] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:30.364467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bb27b-e1ea-4549-b08f-2adfb5fce610 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.376734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bb27b-e1ea-4549-b08f-2adfb5fce610 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.388442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.389144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.389433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.389714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.390474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:30.390778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.392435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.406529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 191/381] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:30.412152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250adf64-06fb-41a9-9f79-3b444f5045e9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.424367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250adf64-06fb-41a9-9f79-3b444f5045e9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.432120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.432906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.433186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.433458 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.455919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.457767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.477858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:30.479354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 191/382] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:30.485089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.499206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa40012-3a44-4798-a774-d7202f400406 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.505532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.506211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.507019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.507950 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.508694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:30.509002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.510610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.538957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 192/383] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:30.546140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.556638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35e21a-eab2-4c85-9673-34657358cf38 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.563612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fd565-f192-489d-8efe-bb0f96fa035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.564428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fd565-f192-489d-8efe-bb0f96fa035e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.564704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fd565-f192-489d-8efe-bb0f96fa035e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.564971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fd565-f192-489d-8efe-bb0f96fa035e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.581200 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fd565-f192-489d-8efe-bb0f96fa035e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.583272 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fd565-f192-489d-8efe-bb0f96fa035e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.607738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-8f2fd565-f192-489d-8efe-bb0f96fa035e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:25:30.608986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 192/384] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:30.615063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.628494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1c58-abba-4ff0-a8ed-515f45751c7b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.640861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.641555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.641836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.642108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.642694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab02bf-10e7-46e6-870a-9065c7731fe5 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.642962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:30.643128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab02bf-10e7-46e6-870a-9065c7731fe5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.643276 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab02bf-10e7-46e6-870a-9065c7731fe5 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.643418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.644295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:30.644295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:30.644295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:30.644998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 193/385] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:30.645434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.675589 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11093-92c5-457a-9e0d-e8a47262691d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.675939 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11093-92c5-457a-9e0d-e8a47262691d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.676146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11093-92c5-457a-9e0d-e8a47262691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.713951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-44c11093-92c5-457a-9e0d-e8a47262691d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:30.715137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-44c11093-92c5-457a-9e0d-e8a47262691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:30.722844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 194/386] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:30.795294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c11093-92c5-457a-9e0d-e8a47262691d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.804708 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c11093-92c5-457a-9e0d-e8a47262691d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.814711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac4c06-4bed-4f4e-b147-d68523acabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.815519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac4c06-4bed-4f4e-b147-d68523acabfb admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.815868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac4c06-4bed-4f4e-b147-d68523acabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.816137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac4c06-4bed-4f4e-b147-d68523acabfb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.826906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 193/387] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:30.832080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.833534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac4c06-4bed-4f4e-b147-d68523acabfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:30.847786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-1eac4c06-4bed-4f4e-b147-d68523acabfb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:30.850732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe957048-bc4e-41ae-a591-e152755de2f0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.853661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 195/388] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:30.855758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d810d0-51fd-4c1d-9874-82e468ae691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.856455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d810d0-51fd-4c1d-9874-82e468ae691a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.856734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d810d0-51fd-4c1d-9874-82e468ae691a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.857001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d810d0-51fd-4c1d-9874-82e468ae691a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.862709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac4c06-4bed-4f4e-b147-d68523acabfb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.869031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d810d0-51fd-4c1d-9874-82e468ae691a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.870815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d810d0-51fd-4c1d-9874-82e468ae691a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.872622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac4c06-4bed-4f4e-b147-d68523acabfb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.885693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.886697 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.887181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.888995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.889935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:30.890483 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.890906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 194/389] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:30.892809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.900661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d810d0-51fd-4c1d-9874-82e468ae691a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.909154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 196/390] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:30.909622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d810d0-51fd-4c1d-9874-82e468ae691a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.916002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:30.925350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.926382 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.926662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.926939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.929515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5643-baeb-418f-b79a-f863dd1c7773 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:30.938160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:30.940673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:30.940969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:30.941247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:30.953520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.955457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.967038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:30.968980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:30.978861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:30.980846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 195/391] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:30.995038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.009078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:31.017138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 197/392] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.019913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.022219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ffb0b-5cba-448e-b18f-ead512fcaaf3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.030706 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4881903-613f-464f-bcd1-3ea9878ec30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.031376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4881903-613f-464f-bcd1-3ea9878ec30c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.031660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4881903-613f-464f-bcd1-3ea9878ec30c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.031956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4881903-613f-464f-bcd1-3ea9878ec30c admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.032686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4881903-613f-464f-bcd1-3ea9878ec30c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.032988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4881903-613f-464f-bcd1-3ea9878ec30c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.034596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4881903-613f-464f-bcd1-3ea9878ec30c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.045891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e095-1475-4f97-add4-2fe32bd157db admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.052000 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b010e-55cb-4c93-87ce-8cfa6c7f859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.053010 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b010e-55cb-4c93-87ce-8cfa6c7f859a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.054191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b010e-55cb-4c93-87ce-8cfa6c7f859a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.054496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 196/393] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:31.054859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b010e-55cb-4c93-87ce-8cfa6c7f859a admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.055852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b010e-55cb-4c93-87ce-8cfa6c7f859a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.056362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b010e-55cb-4c93-87ce-8cfa6c7f859a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.058295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b010e-55cb-4c93-87ce-8cfa6c7f859a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.060737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9488c8-acd3-4d28-b0cf-2fd77b6d461f None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.061045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9488c8-acd3-4d28-b0cf-2fd77b6d461f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.061334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9488c8-acd3-4d28-b0cf-2fd77b6d461f None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.063298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 197/394] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:31 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:31.068283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9488c8-acd3-4d28-b0cf-2fd77b6d461f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.075891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9488c8-acd3-4d28-b0cf-2fd77b6d461f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.083268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 198/395] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:31.083268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d29d1-f829-41ed-ab1e-532916c07064 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.083268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d29d1-f829-41ed-ab1e-532916c07064 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.083268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d29d1-f829-41ed-ab1e-532916c07064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.084620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.085401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.085676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.085945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.093235 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.095200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.108979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:31.115631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 198/396] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.115631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.125062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57b9a0-7b60-4b2e-bc4a-339e2990799c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.129648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.130488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.130768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.131043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] PATH_INFO: `/v3/users/glance` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.140301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.142458 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.158057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:25:31.164169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 199/397] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.164169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.178355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5291e3-e758-4360-8e15-922755841dea admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.187972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.189095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.189598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.190098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.191117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.191666 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.192986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:31.192986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:31.192986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:31.194874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.219741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 200/398] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.219741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.227030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b0c7-fea8-457c-8af5-1c3f183a0afb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.231191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31fa57-482e-45da-a2dd-9e0ff06b4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.231987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31fa57-482e-45da-a2dd-9e0ff06b4385 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.232364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31fa57-482e-45da-a2dd-9e0ff06b4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.232646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31fa57-482e-45da-a2dd-9e0ff06b4385 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.233025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-852d29d1-f829-41ed-ab1e-532916c07064 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:31.233483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31fa57-482e-45da-a2dd-9e0ff06b4385 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.233782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31fa57-482e-45da-a2dd-9e0ff06b4385 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.234176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-852d29d1-f829-41ed-ab1e-532916c07064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:31.235657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31fa57-482e-45da-a2dd-9e0ff06b4385 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.242675 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 199/399] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:31.244199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ccba-6a32-4dc6-8186-149331cead04 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.244515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ccba-6a32-4dc6-8186-149331cead04 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.244755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ccba-6a32-4dc6-8186-149331cead04 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.247748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 200/400] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:31.247748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ccba-6a32-4dc6-8186-149331cead04 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.262629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ccba-6a32-4dc6-8186-149331cead04 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.263485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 201/401] 10.222.0.16 () {56 vars in 1159 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.265026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde6d1-fcd3-41d5-bfa2-c29e79dbdc08 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.265552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde6d1-fcd3-41d5-bfa2-c29e79dbdc08 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.265910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde6d1-fcd3-41d5-bfa2-c29e79dbdc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.267977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.268762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.269175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.269812 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.270791 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=dbe34d9bb0994e7f80044be0a373ed5e) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.271289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.273395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.279120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 201/402] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/role_assignments?user.id=dbe34d9bb0994e7f80044be0a373ed5e&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.280110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.284929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-7abde6d1-fcd3-41d5-bfa2-c29e79dbdc08 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:31.286295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7abde6d1-fcd3-41d5-bfa2-c29e79dbdc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:31.290125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341a385-27bf-4b9c-9f23-8c3257bf544d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.294976 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c58e4-868b-42e8-9d46-6e06e03d7e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.295159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 202/403] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:31.296305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c58e4-868b-42e8-9d46-6e06e03d7e99 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.296785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c58e4-868b-42e8-9d46-6e06e03d7e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.297231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c58e4-868b-42e8-9d46-6e06e03d7e99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.300559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abde6d1-fcd3-41d5-bfa2-c29e79dbdc08 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.306949 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c58e4-868b-42e8-9d46-6e06e03d7e99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.309049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c58e4-868b-42e8-9d46-6e06e03d7e99 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.318349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abde6d1-fcd3-41d5-bfa2-c29e79dbdc08 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.318893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 202/404] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:31.323733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd158-2cb1-4799-8748-c224ea3dc27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.325210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd158-2cb1-4799-8748-c224ea3dc27a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.325210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd158-2cb1-4799-8748-c224ea3dc27a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.325210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd158-2cb1-4799-8748-c224ea3dc27a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.326444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c58e4-868b-42e8-9d46-6e06e03d7e99 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.339612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd158-2cb1-4799-8748-c224ea3dc27a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:31.341473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c58e4-868b-42e8-9d46-6e06e03d7e99 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.345969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.347007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.347242 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5fdcd158-2cb1-4799-8748-c224ea3dc27a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:31.347643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.348109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.349017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 203/405] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.349990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd158-2cb1-4799-8748-c224ea3dc27a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.364203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd158-2cb1-4799-8748-c224ea3dc27a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.364419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.367329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.369751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2125f57-b95f-4cd1-8305-e853d38ce64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.370625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2125f57-b95f-4cd1-8305-e853d38ce64f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.370903 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2125f57-b95f-4cd1-8305-e853d38ce64f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.371229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2125f57-b95f-4cd1-8305-e853d38ce64f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.385592 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2125f57-b95f-4cd1-8305-e853d38ce64f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:31.386854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:31.388553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 203/406] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.389373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.393017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-b2125f57-b95f-4cd1-8305-e853d38ce64f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:31.394288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 204/407] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.395630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2125f57-b95f-4cd1-8305-e853d38ce64f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.404562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9c7d8-6f77-43ab-ab6e-7f50802756a3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.406095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2125f57-b95f-4cd1-8305-e853d38ce64f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.409457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.410226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.410666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.411032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.411133 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.411931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.412034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.412208 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.412345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.412620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.413556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.413914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.414451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.415741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.424328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 204/408] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.430520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 205/409] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.431129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.431312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.441494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa15b7-da84-4399-af31-db5b7d2f4d61 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.447469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.447814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eb2b9-9d0d-4065-ae58-94ca77c68aa3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.448414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.448700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.449027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.452212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.452902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.453185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.453512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.454280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.454584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.456232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.461629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.463899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.466037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 205/410] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.466706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.476042 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2480a-985a-45cd-9c5a-ad46fa72aec1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.480451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.481238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.481519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.481792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.484583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:31.486055 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 206/411] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:31.486751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.494593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.496592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.497449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cbd8b-fc26-458d-a0b2-65fa6cf1e17b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.502063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.502844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.503180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.503461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.511327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:31.512727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 206/412] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.513338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.515389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.517378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.528914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb1bfb-bb3d-4bcd-be92-63587f0824bf admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.533126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.533867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.534181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.534426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.535146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.535446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.537022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:31.537202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.538467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 207/413] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.539264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.549727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 207/414] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.550113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80d1f-a486-4c3b-bdfa-57cade726eee admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.550548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.563348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.564344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.564630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.564909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.565698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.565967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4afb72-f4a8-4b0a-bc44-222ad8cee5a7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.566114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.568103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.570925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.572203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.572555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.572905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.573734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.574219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.576441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.581524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 208/415] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.582182 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.597062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4057-5d97-4b36-a839-deb40e8bbf25 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.597580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 208/416] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.598234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.601612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.602400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.602683 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.602959 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.608539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5a3c5-2ad2-4a6b-9f73-f4c8223e2b79 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.611828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.613024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.613810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.613983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.614132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.614456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.615407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=b8eb54ff54264f309aa5949ed8aef453) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.616297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.618478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.627841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 209/417] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/role_assignments?user.id=b8eb54ff54264f309aa5949ed8aef453&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.628130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:25:31.628721 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.629347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 209/418] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.635945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.643341 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0873c3-cb86-4817-a06c-325ceb8ab382 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.645699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb0137-50ce-4a5e-b224-ee6bc34d4294 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.657640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.659302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.659622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.659981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.660260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.661838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.662117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.662566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.663148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.663959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.667001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.682505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.684650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.713257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 210/419] 10.222.0.16 () {56 vars in 1159 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:31.714362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:25:31.715681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 210/420] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.721021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.731329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219b93-16a2-462f-b1e2-4757f8223f89 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.733973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.745975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0af25-e5b2-4fb0-96f0-7b1d0a155169 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.747192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3149-182d-4d67-ada2-6993ace94981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.747937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3149-182d-4d67-ada2-6993ace94981 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.748217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3149-182d-4d67-ada2-6993ace94981 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.748923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3149-182d-4d67-ada2-6993ace94981 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.755967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.757814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.758097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.758375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.761895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.762222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.764608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:31.764608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:31.764608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:31.765759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.767574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e3149-182d-4d67-ada2-6993ace94981 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.770276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e3149-182d-4d67-ada2-6993ace94981 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.789631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 211/421] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:31.796877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3149-182d-4d67-ada2-6993ace94981 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.809010 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3149-182d-4d67-ada2-6993ace94981 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.824344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.825186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.825467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.825739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.837055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 211/422] 10.222.0.16 () {56 vars in 1161 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:31.843167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.844376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.846463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.854169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a76bea-cdd8-4637-aafa-5f47d9599a2b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.859620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8b698-7f9c-4356-829b-199f28eef103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.860378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8b698-7f9c-4356-829b-199f28eef103 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.860665 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8b698-7f9c-4356-829b-199f28eef103 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.860941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8b698-7f9c-4356-829b-199f28eef103 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.868820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:31.870977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 212/423] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:31.871080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8b698-7f9c-4356-829b-199f28eef103 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.875780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8b698-7f9c-4356-829b-199f28eef103 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.878414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.887363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 212/424] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:31.892074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aabdcb-086a-420b-bf3c-3b8815fdf198 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.893454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8b698-7f9c-4356-829b-199f28eef103 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.902311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8b698-7f9c-4356-829b-199f28eef103 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.906498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.907735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.908026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.908305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.909037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:31.909343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.910979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.915391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.916207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.916491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.916766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.934940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 213/425] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:31.936943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.938794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.942164 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.957098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87a707-0bfd-4a8d-b5f7-1d62584f90a0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:31.962429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:31.963283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:31.963850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:31.964177 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:31.970758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:31.971640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:31.972168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 213/426] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:31.973757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:31.979241 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:31.990116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:31.991962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 214/427] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:31.993669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d145-cf4a-48b0-9290-aa0ddc91dc6f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.001733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:32.005557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.006267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.007362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.007639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.009674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:32.009981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.012849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.022743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735140a-7d47-4924-81fa-2275c602185b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.032144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0498e-8245-4ed8-870e-1deb83c87118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.035212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0498e-8245-4ed8-870e-1deb83c87118 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.035548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0498e-8245-4ed8-870e-1deb83c87118 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.035885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0498e-8245-4ed8-870e-1deb83c87118 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.037313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0498e-8245-4ed8-870e-1deb83c87118 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:32.038141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0498e-8245-4ed8-870e-1deb83c87118 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.042096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0498e-8245-4ed8-870e-1deb83c87118 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.043177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 214/428] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:32.049349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:32.063163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13025-1ead-409a-9b8d-5152f4c9447a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.067145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 215/429] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:32.067645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0e692-b3a7-4ade-9782-f7f655e81d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.068564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0e692-b3a7-4ade-9782-f7f655e81d8b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.068894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0e692-b3a7-4ade-9782-f7f655e81d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.069193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0e692-b3a7-4ade-9782-f7f655e81d8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.070052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3411-33ad-4429-b101-daa1ae94abf5 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.070528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3411-33ad-4429-b101-daa1ae94abf5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.071213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3411-33ad-4429-b101-daa1ae94abf5 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.073834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 216/430] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:32.075033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3411-33ad-4429-b101-daa1ae94abf5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:32.081254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0e692-b3a7-4ade-9782-f7f655e81d8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.083245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0e692-b3a7-4ade-9782-f7f655e81d8b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.088820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3411-33ad-4429-b101-daa1ae94abf5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.093751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.094680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.095156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.095701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.096592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-c1b0e692-b3a7-4ade-9782-f7f655e81d8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:32.097042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=a02f0a6cbe5442da8bd2f78643d31aba) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:32.097543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.099727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.103819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 215/431] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:32.105191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdb4b-be02-45b5-9684-6e2a8331eabe None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.105482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdb4b-be02-45b5-9684-6e2a8331eabe None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.105763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdb4b-be02-45b5-9684-6e2a8331eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.108114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 217/432] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:32 2021] GET /identity/v3/role_assignments?user.id=a02f0a6cbe5442da8bd2f78643d31aba&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:32.109314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:32.125304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0047-0631-45a6-b0c3-d0250cdc3af5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.128344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c61fdb4b-be02-45b5-9684-6e2a8331eabe None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:32.129534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c61fdb4b-be02-45b5-9684-6e2a8331eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:32.130703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.131902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.132492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.133111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.134251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:32.134753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.137163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.137406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 216/433] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:32.151970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 218/434] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:32.163760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fdb4b-be02-45b5-9684-6e2a8331eabe None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:32.181763 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:32.182471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fdb4b-be02-45b5-9684-6e2a8331eabe None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.186874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.187598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.187917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.188244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.191729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=78279cb4fa504d18943cd8807b674cf9) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:32.191729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.191729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.198221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 217/435] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:32 2021] GET /identity/v3/role_assignments?user.id=78279cb4fa504d18943cd8807b674cf9&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:32.198706 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c7a5-3ff8-4975-9930-bdd978552336 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.212664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.214131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.214610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.215077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.232122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.234378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.262742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:32.264689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 219/436] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:32.271542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:32.287135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072600bb-5e81-4976-a6fa-d630d35e16b4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.296891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254fa1-ce4a-48dc-95d4-af1d788b230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.297961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254fa1-ce4a-48dc-95d4-af1d788b230e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.298446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254fa1-ce4a-48dc-95d4-af1d788b230e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.298910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254fa1-ce4a-48dc-95d4-af1d788b230e admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.299880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254fa1-ce4a-48dc-95d4-af1d788b230e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:32.300418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254fa1-ce4a-48dc-95d4-af1d788b230e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.305653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254fa1-ce4a-48dc-95d4-af1d788b230e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.324889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 218/437] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:32.331044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:32.344928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd229d8b-d12f-4e51-801b-1f2b3d98643f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:32.355567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101f0db-2e0d-484c-bd27-fc2e335be94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:32.356654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101f0db-2e0d-484c-bd27-fc2e335be94d admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:32.357137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101f0db-2e0d-484c-bd27-fc2e335be94d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:32.357620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101f0db-2e0d-484c-bd27-fc2e335be94d admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:32.358530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101f0db-2e0d-484c-bd27-fc2e335be94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:32.360700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101f0db-2e0d-484c-bd27-fc2e335be94d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:32.394161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 220/438] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:25:32 2021] POST /identity/v3/users => generated 247 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:25:33.646270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05411-d7ad-4ca0-9e8a-7525f73fe021 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:33.646779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05411-d7ad-4ca0-9e8a-7525f73fe021 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:33.646853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05411-d7ad-4ca0-9e8a-7525f73fe021 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:33.649025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 219/439] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:33.655379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c914f8-ef35-47df-8446-90830cafc7f4 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:33.655824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c914f8-ef35-47df-8446-90830cafc7f4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:33.656011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c914f8-ef35-47df-8446-90830cafc7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:33.680697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-36c914f8-ef35-47df-8446-90830cafc7f4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:33.681878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-36c914f8-ef35-47df-8446-90830cafc7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:33.693653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 221/440] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:33.742783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05411-d7ad-4ca0-9e8a-7525f73fe021 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:33.757847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05411-d7ad-4ca0-9e8a-7525f73fe021 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:33.764951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3223-406f-46de-bef1-e6f615ec2c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:33.765814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3223-406f-46de-bef1-e6f615ec2c2f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:33.766101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3223-406f-46de-bef1-e6f615ec2c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:33.766432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3223-406f-46de-bef1-e6f615ec2c2f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:33.788587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3223-406f-46de-bef1-e6f615ec2c2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:33.795469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-fc2a3223-406f-46de-bef1-e6f615ec2c2f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:33.797088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 220/441] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:33.804062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c914f8-ef35-47df-8446-90830cafc7f4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:33.817610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c914f8-ef35-47df-8446-90830cafc7f4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:33.823044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:33.823753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:33.824015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:33.824292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:33.825048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:33.825356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:33.826991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:33.840186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 222/442] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:33.846510 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3223-406f-46de-bef1-e6f615ec2c2f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:33.861838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3223-406f-46de-bef1-e6f615ec2c2f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:33.866901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:33.867773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:33.868057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:33.868334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:33.882022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:33.883905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:33.908706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:33.909991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 221/443] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:33.916343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:33.933847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40682-070b-4552-bfab-b659be699003 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:33.941789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87d2cf-0b69-4ba8-9618-e2591328598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:33.942480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d2cf-0b69-4ba8-9618-e2591328598d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:33.942764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d2cf-0b69-4ba8-9618-e2591328598d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:33.943040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d2cf-0b69-4ba8-9618-e2591328598d admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:33.943856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87d2cf-0b69-4ba8-9618-e2591328598d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:33.944216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87d2cf-0b69-4ba8-9618-e2591328598d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:33.945869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87d2cf-0b69-4ba8-9618-e2591328598d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:33.967275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 223/444] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:33.973655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:33.988720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4d5e-59f3-40e1-beca-fd90e21615fa admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:33.995626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:33.996442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:33.996715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:33.996991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.012733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.014810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.014999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7a125-fcd4-4ec2-b1f0-e8de913361e3 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.015239 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7a125-fcd4-4ec2-b1f0-e8de913361e3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.015461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7a125-fcd4-4ec2-b1f0-e8de913361e3 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.017760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 224/445] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:34.026506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391cc9-28fa-45af-8302-9c35872468e3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.026797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391cc9-28fa-45af-8302-9c35872468e3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.027091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391cc9-28fa-45af-8302-9c35872468e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.029823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:25:34.031338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 222/446] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:25:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:34.038256 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.048482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc79cb-0873-4078-adec-1e61b3327683 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.053305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.053963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.054283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.054570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.055487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:34.055826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.058141 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.064695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e3391cc9-28fa-45af-8302-9c35872468e3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:34.065889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e3391cc9-28fa-45af-8302-9c35872468e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:34.081340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 225/447] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:34.083917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 223/448] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:34.091058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3391cc9-28fa-45af-8302-9c35872468e3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.100640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3391cc9-28fa-45af-8302-9c35872468e3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.105103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.105962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.106297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.106582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.118031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.119964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.133631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.145350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d1e9b-0659-4523-ac7e-70b2c9cf72da admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.151610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:34.154685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f6eb5-ebe6-4b80-97f6-65dddc8b3f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.155560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6eb5-ebe6-4b80-97f6-65dddc8b3f3f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.159987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6eb5-ebe6-4b80-97f6-65dddc8b3f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.160228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6eb5-ebe6-4b80-97f6-65dddc8b3f3f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.160654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 226/449] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:34.166042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.183219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4903d1-9dc2-41ef-8ac2-2dee0a622f05 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.184958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f6eb5-ebe6-4b80-97f6-65dddc8b3f3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:34.193643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.195102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.195385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.196451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.197846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-786f6eb5-ebe6-4b80-97f6-65dddc8b3f3f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:34.198736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:34.199048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.200963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 224/450] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:34.201946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.207427 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f6eb5-ebe6-4b80-97f6-65dddc8b3f3f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.221702 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 227/451] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:34.227738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f6eb5-ebe6-4b80-97f6-65dddc8b3f3f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.230753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.232020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.232747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.233027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.233303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.234100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:34.234402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.236198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.249030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57109cf3-199b-486f-b18e-9f90a5c87e2b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.253794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 225/452] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:34.257903 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.258792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.259070 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.260305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.264652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.274974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e366fcc-87f0-4af8-b41b-50552840f8e1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.278957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.282168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.285247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.286184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.286461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.286733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.302355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:34.304516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 228/453] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:34.309619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.310702 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.311554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.321826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a5f42-0a8f-457b-90ac-213885888ec3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.326259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.326912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.327234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.327510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.328325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:34.328676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.330586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.341866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:34.344764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 229/455] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:34.345786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 226/455] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:34.349831 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.352836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.361333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c272-bc79-4eb7-93c0-b6dde18b175b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.364500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe4bd-abe5-47ff-9a97-c83a8dc5e35d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.366497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.367526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.368334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.368615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.370063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:34.370375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.374771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.375912 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e2ad-5066-4932-8a3e-58a925f793e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.376889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e2ad-5066-4932-8a3e-58a925f793e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.377166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e2ad-5066-4932-8a3e-58a925f793e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.377435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e2ad-5066-4932-8a3e-58a925f793e8 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/dbe34d9bb0994e7f80044be0a373ed5e/roles/2b4c5582fd5d417996790d0ed9464d51` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.400144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 230/456] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:34.405446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6e2ad-5066-4932-8a3e-58a925f793e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=dbe34d9bb0994e7f80044be0a373ed5e, role_id=2b4c5582fd5d417996790d0ed9464d51)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.407361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.414237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6e2ad-5066-4932-8a3e-58a925f793e8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.421759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d2217-6a50-4aa8-ac1e-1c0c34af2af1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.430160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.431136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.431503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.431844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] PATH_INFO: `/v3/users/glance` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.443332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 227/457] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:34 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/dbe34d9bb0994e7f80044be0a373ed5e/roles/2b4c5582fd5d417996790d0ed9464d51 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:34.452143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.454290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.473286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:25:34.474846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 231/458] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/users/glance => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:34.481297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e2ad-5066-4932-8a3e-58a925f793e8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.562266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e2ad-5066-4932-8a3e-58a925f793e8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.570423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.571111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.571386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.571661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.572528 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:34.572888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.574762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.598911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 228/459] 10.222.0.16 () {56 vars in 1159 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:34.604996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.614449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c89dd-e2e0-40fe-9686-18a572104bff admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.623725 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.624622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.624971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.625309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.641875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.643852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.661891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:34.664363 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 232/460] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:34.676869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.687366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36554d43-13de-4be0-8279-e809196a5e78 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.692910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.693575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.693927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.694800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.695538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:34.695872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.697484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.715905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 229/461] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:34.722210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.736284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da76d-8cde-4ab2-a0c4-72cbdf301271 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.740611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ea437-b4bb-439e-ac84-97f3784dc67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.742550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea437-b4bb-439e-ac84-97f3784dc67b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.742828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea437-b4bb-439e-ac84-97f3784dc67b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.743096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea437-b4bb-439e-ac84-97f3784dc67b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.750430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ea437-b4bb-439e-ac84-97f3784dc67b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.752426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ea437-b4bb-439e-ac84-97f3784dc67b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.775049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-fa8ea437-b4bb-439e-ac84-97f3784dc67b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:34.776381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 233/462] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:34.783264 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.797325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7852-f00b-48da-ad8c-e27e3367de82 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.806765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.807462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.807783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.808068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.808902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:34.809211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.810273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:34.810273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:34.810273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:34.811426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.844575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 230/463] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:34.849927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cb67-3a6c-458c-9d1c-3b4775855e75 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.850295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cb67-3a6c-458c-9d1c-3b4775855e75 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.850651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cb67-3a6c-458c-9d1c-3b4775855e75 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.850951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:34.852994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 234/464] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:34.859140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02881-d431-4e1b-9d8d-e6ab88178fde None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.859439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02881-d431-4e1b-9d8d-e6ab88178fde None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.859683 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02881-d431-4e1b-9d8d-e6ab88178fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.861027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62373ab-d751-41cd-9731-8515298ad406 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:34.865408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b321d4-aaed-4a14-829e-450b6c53eee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:34.866353 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b321d4-aaed-4a14-829e-450b6c53eee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.866696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b321d4-aaed-4a14-829e-450b6c53eee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.866901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b321d4-aaed-4a14-829e-450b6c53eee1 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/b8eb54ff54264f309aa5949ed8aef453/roles/2b4c5582fd5d417996790d0ed9464d51` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.883633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b321d4-aaed-4a14-829e-450b6c53eee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=b8eb54ff54264f309aa5949ed8aef453, role_id=2b4c5582fd5d417996790d0ed9464d51)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:34.886343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b321d4-aaed-4a14-829e-450b6c53eee1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:34.900328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b9d02881-d431-4e1b-9d8d-e6ab88178fde None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:34.901664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b9d02881-d431-4e1b-9d8d-e6ab88178fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:34.903437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 231/465] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:34 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/b8eb54ff54264f309aa5949ed8aef453/roles/2b4c5582fd5d417996790d0ed9464d51 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:34.909182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a1e4-1065-4baa-acaf-11a639e89f23 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.909488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a1e4-1065-4baa-acaf-11a639e89f23 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.909735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a1e4-1065-4baa-acaf-11a639e89f23 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.911876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 232/466] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:34 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:34.919561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b05802-15d0-45f7-baae-ccff07c4d41c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:34.919864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b05802-15d0-45f7-baae-ccff07c4d41c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:34.920049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b05802-15d0-45f7-baae-ccff07c4d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:34.946361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-04b05802-15d0-45f7-baae-ccff07c4d41c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:34.947578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-04b05802-15d0-45f7-baae-ccff07c4d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:35.003408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 235/467] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 28 03:25:35.040642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02881-d431-4e1b-9d8d-e6ab88178fde None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.050484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02881-d431-4e1b-9d8d-e6ab88178fde None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.051128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 233/468] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:35.055116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53408-03c9-413b-bbe3-d2b0f3229fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.055970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53408-03c9-413b-bbe3-d2b0f3229fbf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.056249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53408-03c9-413b-bbe3-d2b0f3229fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.056519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53408-03c9-413b-bbe3-d2b0f3229fbf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.067955 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf53408-03c9-413b-bbe3-d2b0f3229fbf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:35.075581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-dbf53408-03c9-413b-bbe3-d2b0f3229fbf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:35.077216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 236/469] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:35.084615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b05802-15d0-45f7-baae-ccff07c4d41c None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.088973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53408-03c9-413b-bbe3-d2b0f3229fbf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.098609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b05802-15d0-45f7-baae-ccff07c4d41c None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.100023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53408-03c9-413b-bbe3-d2b0f3229fbf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.106269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.106952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.107235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.107515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.108297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.108603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.110232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.112415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b11d2-9693-4c13-82a0-9b548157d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.113280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b11d2-9693-4c13-82a0-9b548157d923 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.113564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b11d2-9693-4c13-82a0-9b548157d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.113840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b11d2-9693-4c13-82a0-9b548157d923 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.124774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 234/470] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:35.127134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b11d2-9693-4c13-82a0-9b548157d923 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:35.130652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.134629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-688b11d2-9693-4c13-82a0-9b548157d923 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:35.135940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 237/471] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:35.142205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b11d2-9693-4c13-82a0-9b548157d923 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.144914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ba99-017f-4aa4-9f39-36664fe8a82f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.152615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b11d2-9693-4c13-82a0-9b548157d923 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.155180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.156111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.156400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.156675 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.157272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.158100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.158538 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.158971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.159912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.160225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.161837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.171482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 238/472] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:35.172544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.174622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.177422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.191759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566d60-c79f-4ec5-ac86-2610be9a7a67 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.191759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.191759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.192095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.192194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.207750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:35.207914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.207914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.213058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 235/473] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:35.219617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.223493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:35.224906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 239/474] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:35.231434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.239266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc204-b3d9-4fe4-a68c-d7004254b557 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.240503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921affce-b5a3-44a9-8f06-b923e9a4e548 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.244951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.245600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.245881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.246158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.246884 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.247191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.248839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.253698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.254368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.254650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.254928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.255656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.255993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.257780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.261636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 240/475] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:35.267507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.277401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6f257-567a-4eb9-984a-9144f4c637fa admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.281746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.282376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 236/476] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:35.282538 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.282875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.283158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.289502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.292031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.294157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.304836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5bd67-8a21-4d80-95b5-b2a3c4fd9e75 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.308957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:25:35.310434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 241/477] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:35.314593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.315498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.315811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.316089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.316401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.325134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.326093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a66583-2635-4b10-a733-deca9f414c94 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.327154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.330359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.331014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.331292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.331571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.332479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.332816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.334697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.353371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 242/478] 10.222.0.16 () {56 vars in 1159 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:35.355311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:25:35.359272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.361588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 237/479] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/users/neutron => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:35.362597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.369575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a20509-9d07-4957-8bc1-d4bccaa27a4a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.373877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.374659 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.374943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.375218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.380189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b1f7-0903-4c90-bac8-fd3a74f0328f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.385808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.387679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.392918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.393597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.393881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.394158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.395017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.395302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.397803 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.418878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:35.432169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 243/480] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:35.433625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.443456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563bc8-6aae-4716-8c63-bc442b6b3051 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.445810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 238/481] 10.222.0.16 () {56 vars in 1161 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:35.449695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.450341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.450622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.450897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.451949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.452262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.452624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.453969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.466630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 244/482] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:35.468848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669f7f3-1768-4290-b77c-27df9c6d5313 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.472674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.476965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.477876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.478254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.478615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.482532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac51523-625a-45ab-9084-41c687dbf5bc admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.493899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.494695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.494978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.495255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.499694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.501560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.508008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.509971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.530852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:35.533300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 245/483] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:35.545263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:35.546728 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 239/484] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:35.553048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.553217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.564877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb84c09-eaae-4a61-9919-502d33cde3a6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.569122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb50dd-a116-4efd-b51e-d4d1d17e62eb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.569621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.570519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.570949 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.571365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.572300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.572729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.574547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.584354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.585192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.585615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.585989 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.586885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.587305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.588279 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 240/485] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:35.593486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.594629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.604635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc4a7-f876-46a3-b70c-bb72f5ef79fe admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.612384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.612855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 246/486] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:35.613857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.614335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.614748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.618807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.631915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.634245 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94531e-28d5-4cf7-a5da-8b8fb01d1f1c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.637319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.644200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14979d8f-2942-4f97-aa1c-85ccab368882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.646672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979d8f-2942-4f97-aa1c-85ccab368882 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.647251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979d8f-2942-4f97-aa1c-85ccab368882 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.647936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979d8f-2942-4f97-aa1c-85ccab368882 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/a02f0a6cbe5442da8bd2f78643d31aba/roles/2b4c5582fd5d417996790d0ed9464d51` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.669524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:35.673143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 241/487] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:35.680990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.683338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14979d8f-2942-4f97-aa1c-85ccab368882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=a02f0a6cbe5442da8bd2f78643d31aba, role_id=2b4c5582fd5d417996790d0ed9464d51)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.685996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14979d8f-2942-4f97-aa1c-85ccab368882 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.691635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf57b-fb11-45ed-ace5-4f84bbd1fbe0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.697967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc705deb-3f0a-4525-9df8-f991f0b5c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.698902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705deb-3f0a-4525-9df8-f991f0b5c331 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.699328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705deb-3f0a-4525-9df8-f991f0b5c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.699835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705deb-3f0a-4525-9df8-f991f0b5c331 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.700813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc705deb-3f0a-4525-9df8-f991f0b5c331 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:35.701322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc705deb-3f0a-4525-9df8-f991f0b5c331 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.703385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc705deb-3f0a-4525-9df8-f991f0b5c331 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.708444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 247/488] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:35 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/a02f0a6cbe5442da8bd2f78643d31aba/roles/2b4c5582fd5d417996790d0ed9464d51 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:35.718524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 242/489] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:35.725455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14979d8f-2942-4f97-aa1c-85ccab368882 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.735007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c7a9-3afa-40c0-8c21-6c10efbd0fe9 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.735577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c7a9-3afa-40c0-8c21-6c10efbd0fe9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.736059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c7a9-3afa-40c0-8c21-6c10efbd0fe9 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.738060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 243/490] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:35.750958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcdd2-54d1-4b96-9f39-08dcf66b90f4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.751477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcdd2-54d1-4b96-9f39-08dcf66b90f4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.751982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcdd2-54d1-4b96-9f39-08dcf66b90f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.780313 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-573fcdd2-54d1-4b96-9f39-08dcf66b90f4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:35.781810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-573fcdd2-54d1-4b96-9f39-08dcf66b90f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:35.863468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14979d8f-2942-4f97-aa1c-85ccab368882 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.865526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 244/491] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:35.877802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564ddd5-518e-4169-8129-6726e72956f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.879019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ddd5-518e-4169-8129-6726e72956f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.879444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ddd5-518e-4169-8129-6726e72956f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.879886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ddd5-518e-4169-8129-6726e72956f7 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/78279cb4fa504d18943cd8807b674cf9/roles/2b4c5582fd5d417996790d0ed9464d51` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.894195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fcdd2-54d1-4b96-9f39-08dcf66b90f4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:35.905169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564ddd5-518e-4169-8129-6726e72956f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=78279cb4fa504d18943cd8807b674cf9, role_id=2b4c5582fd5d417996790d0ed9464d51)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:35.907212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fcdd2-54d1-4b96-9f39-08dcf66b90f4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:35.908447 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564ddd5-518e-4169-8129-6726e72956f7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:35.912613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63a06-76de-4b55-9200-788a021b71e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:35.912866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63a06-76de-4b55-9200-788a021b71e3 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:35.913327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63a06-76de-4b55-9200-788a021b71e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:35.913742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63a06-76de-4b55-9200-788a021b71e3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:35.926092 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e63a06-76de-4b55-9200-788a021b71e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:35.927550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 248/492] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:35 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/78279cb4fa504d18943cd8807b674cf9/roles/2b4c5582fd5d417996790d0ed9464d51 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:35.934513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-77e63a06-76de-4b55-9200-788a021b71e3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:35.936209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 245/493] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:35.943098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564ddd5-518e-4169-8129-6726e72956f7 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.021048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564ddd5-518e-4169-8129-6726e72956f7 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.029467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.030157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.030440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.030732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.031533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] RBAC: Adding query filter params (name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:36.031886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.033528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.043797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 249/494] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:36.050270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63a06-76de-4b55-9200-788a021b71e3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.069232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63a06-76de-4b55-9200-788a021b71e3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.078067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.079061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.079438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.079834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.105007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.107074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.128900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:36.130567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 246/495] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:36.137022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.153710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc31d5-da23-4e17-a455-377d3328aa5b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.160380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.161204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.161624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.161897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.163304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:36.163646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.165454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.182098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 250/496] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:36.188233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.197809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23623ba2-d530-4eab-94cb-7ad4e97db9d8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.202815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.203657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.204062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.204386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.214406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.216512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.231163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:25:36.232741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 247/497] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:36.239031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.249327 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503d2d-01f9-4410-a4cb-eb2c90fe627f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.253691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.254408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.254684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.255000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.255876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:36.256258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.258246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.281914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 251/498] 10.222.0.16 () {56 vars in 1157 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:36.288639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.297977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a9dfe-344f-4bd2-98a0-05a991a08226 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.307962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849a12-5bfc-4ba8-a72b-b423cb4ac50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.308650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849a12-5bfc-4ba8-a72b-b423cb4ac50c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.308927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849a12-5bfc-4ba8-a72b-b423cb4ac50c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.309253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849a12-5bfc-4ba8-a72b-b423cb4ac50c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.317283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849a12-5bfc-4ba8-a72b-b423cb4ac50c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.319583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849a12-5bfc-4ba8-a72b-b423cb4ac50c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.328180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 248/499] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:36.334539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.344177 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8fca7-f693-47af-aa17-71e4f6a6a799 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.348513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.349298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.349629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.349900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.361088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.362985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.385207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:36.386515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 252/500] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:36.392651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849a12-5bfc-4ba8-a72b-b423cb4ac50c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.401439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849a12-5bfc-4ba8-a72b-b423cb4ac50c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.411538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.412226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.413013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.413284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.414139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:36.414439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.416110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.433797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 249/501] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:36.439982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.452339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a1c02-c191-4eef-8e98-ec8693a637d4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.459498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.460434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.460708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.460983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.472785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.474770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.493058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:36.494260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 253/502] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:36.500882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.517760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca022-92b3-4df0-bba0-e7d5704a907b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.527040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c7436-a2de-4c57-88a8-7c0d51cac2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.527996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7436-a2de-4c57-88a8-7c0d51cac2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.528580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7436-a2de-4c57-88a8-7c0d51cac2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.529073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7436-a2de-4c57-88a8-7c0d51cac2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.530054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c7436-a2de-4c57-88a8-7c0d51cac2e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:36.530562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c7436-a2de-4c57-88a8-7c0d51cac2e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.532644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c7436-a2de-4c57-88a8-7c0d51cac2e9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.548440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 250/503] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:36.555510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:36.568234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad833a2d-2d47-4c48-8889-bb5b84d36d8f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:36.574998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425822d-c035-4f2d-a4aa-8871100da188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:36.575651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425822d-c035-4f2d-a4aa-8871100da188 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:36.575998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425822d-c035-4f2d-a4aa-8871100da188 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:36.576280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425822d-c035-4f2d-a4aa-8871100da188 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:36.577116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425822d-c035-4f2d-a4aa-8871100da188 admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=7195fd0ceaf6413d80120c47b3c86358) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:36.577425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425822d-c035-4f2d-a4aa-8871100da188 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:36.579286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425822d-c035-4f2d-a4aa-8871100da188 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:36.588657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 254/504] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:36 2021] GET /identity/v3/role_assignments?user.id=7195fd0ceaf6413d80120c47b3c86358&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:37.585516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffc163-1962-46d8-802f-d605f6470834 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.586047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffc163-1962-46d8-802f-d605f6470834 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.586047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffc163-1962-46d8-802f-d605f6470834 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.588143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 251/505] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:37.592178 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09cc0-10ff-48b5-a839-1e1b7fb7b475 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.593017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09cc0-10ff-48b5-a839-1e1b7fb7b475 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.593499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09cc0-10ff-48b5-a839-1e1b7fb7b475 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.594921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077851a-dce8-4a18-810e-23dc4ee79bc2 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.595209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077851a-dce8-4a18-810e-23dc4ee79bc2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.595487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077851a-dce8-4a18-810e-23dc4ee79bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.596248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 255/506] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:37.602918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab9a6-2bd9-4d06-b5e2-dc83cbe6a16d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.603457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab9a6-2bd9-4d06-b5e2-dc83cbe6a16d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.604007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab9a6-2bd9-4d06-b5e2-dc83cbe6a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.621997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6a4ab9a6-2bd9-4d06-b5e2-dc83cbe6a16d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:37.623524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6a4ab9a6-2bd9-4d06-b5e2-dc83cbe6a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:37.624672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3077851a-dce8-4a18-810e-23dc4ee79bc2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:37.625810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3077851a-dce8-4a18-810e-23dc4ee79bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:37.632332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 256/507] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:37.637896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 252/508] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:37.657778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab9a6-2bd9-4d06-b5e2-dc83cbe6a16d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.666976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab9a6-2bd9-4d06-b5e2-dc83cbe6a16d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.671569 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49919b8d-18fd-4195-97b0-62173b3a79a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.672655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49919b8d-18fd-4195-97b0-62173b3a79a0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.673143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49919b8d-18fd-4195-97b0-62173b3a79a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.673621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49919b8d-18fd-4195-97b0-62173b3a79a0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.685185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49919b8d-18fd-4195-97b0-62173b3a79a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:37.686525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077851a-dce8-4a18-810e-23dc4ee79bc2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.692883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-49919b8d-18fd-4195-97b0-62173b3a79a0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:37.695145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 257/509] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:37.699730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077851a-dce8-4a18-810e-23dc4ee79bc2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.705281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49919b8d-18fd-4195-97b0-62173b3a79a0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.710098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1cc8d-bb18-4344-a996-9aa91aef762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.711180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1cc8d-bb18-4344-a996-9aa91aef762e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.711930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1cc8d-bb18-4344-a996-9aa91aef762e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.711930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1cc8d-bb18-4344-a996-9aa91aef762e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.721881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49919b8d-18fd-4195-97b0-62173b3a79a0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.729701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.730557 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.732964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.733385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.734288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:37.734748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:37.736509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:37.737470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1cc8d-bb18-4344-a996-9aa91aef762e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:37.745031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-35f1cc8d-bb18-4344-a996-9aa91aef762e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:37.751783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 253/510] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:37.759634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1cc8d-bb18-4344-a996-9aa91aef762e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.761998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 258/511] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:37.768449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.771686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1cc8d-bb18-4344-a996-9aa91aef762e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.777670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4efd6-cde7-4ce1-9833-def48d3ad965 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.782173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.782374 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.783175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.783295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.783646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.783866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.784145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.784424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.785301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:37.785747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:37.788038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:37.795848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:37.797679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:37.812146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 254/512] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:37.815617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:37.817206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 259/513] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:37.818493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.824825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.839838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3056a4-dcb9-41b0-8a7b-40026ac5c467 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.842082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2224ce8-8f42-46ad-bdea-bad8e8262f4a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.849616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.851080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.852129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.852651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.853126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.856106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.857395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.860046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.861000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:37.861514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:37.865364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:37.877059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:37.878715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:37.881117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 260/514] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:37.888061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.896290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:37.904831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 255/515] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:37.904831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.909119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b79bc-e802-4c0a-bfd9-fc45495bb3a5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.916767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.917563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.920180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.920476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.922590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff4d2-fe26-439b-a6c9-98f19b3d38ae admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:37.932845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:37.933502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:37.934963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:37.935244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:37.936425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:37.937862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:37.938164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:37.939947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:37.942045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:37.967866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 256/516] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:37.972150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:25:37.973692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 261/517] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:37.976779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.987058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:37.995008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d174c-7d93-4736-9496-2951ae8bfbd9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.003035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270f8fa-78d8-451f-814f-dc7520324e68 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.005351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.006163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.007378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.008459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.013789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.015733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.016011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.016671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.017514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.017817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.021307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.026533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.031830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.061468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:25:38.070106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 262/518] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:38.070275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 257/519] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:37 2021] GET /identity/v3/users/glance => generated 84 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.071856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.077068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.089780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157082-446d-4a02-8d43-396c9add8c0d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.093156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108eed7-20b8-419d-8cf3-2712b996f693 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.096301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.097330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.097834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.098316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.099381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.099936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.102725 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.112541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb21ff7-8447-4e5f-8e9f-b0ebed1573d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.113230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21ff7-8447-4e5f-8e9f-b0ebed1573d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.113515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21ff7-8447-4e5f-8e9f-b0ebed1573d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.113872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21ff7-8447-4e5f-8e9f-b0ebed1573d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.126029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 263/520] 10.222.0.16 () {56 vars in 1159 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.132217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.141700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb21ff7-8447-4e5f-8e9f-b0ebed1573d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.144333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb21ff7-8447-4e5f-8e9f-b0ebed1573d4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.149378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a420-f0c7-450b-92d7-0e00ad229642 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.158540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67645e1-5820-4c40-8476-3f97b7f7a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.160977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67645e1-5820-4c40-8476-3f97b7f7a6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.164927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67645e1-5820-4c40-8476-3f97b7f7a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.165472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67645e1-5820-4c40-8476-3f97b7f7a6c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.170374 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 258/521] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:38.176187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67645e1-5820-4c40-8476-3f97b7f7a6c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.180164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1344b9-8f70-4795-a9c4-3c77d89af96f None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.180787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1344b9-8f70-4795-a9c4-3c77d89af96f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.181298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1344b9-8f70-4795-a9c4-3c77d89af96f None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.183493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 259/522] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:38.184583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1344b9-8f70-4795-a9c4-3c77d89af96f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.187619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67645e1-5820-4c40-8476-3f97b7f7a6c1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.200173 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1344b9-8f70-4795-a9c4-3c77d89af96f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.200787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 264/523] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:38.202807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4eefb-a0be-4a85-be18-b0868f7099b2 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.203466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4eefb-a0be-4a85-be18-b0868f7099b2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.204116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4eefb-a0be-4a85-be18-b0868f7099b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.204484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.205344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.205623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.205899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.219363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.221634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.224591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-34c4eefb-a0be-4a85-be18-b0868f7099b2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:38.226267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-34c4eefb-a0be-4a85-be18-b0868f7099b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:38.233826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 265/524] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:38.234603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4eefb-a0be-4a85-be18-b0868f7099b2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.241890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:38.243378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 260/525] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.252628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4eefb-a0be-4a85-be18-b0868f7099b2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.254100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.257156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.257979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.258260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.258533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.265389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb594f-f0fb-49d3-ba79-8bfc7e36d8c1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.269204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.271491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.274197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.275060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.275340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.275612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.276728 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.277025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.278611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.292261 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:38.293875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 266/526] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.294859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.296983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 261/527] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.297855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.305817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbacfb-299b-4621-85da-b057b7af3ef8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.309304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472359f-27e4-444a-9533-97bef82123e2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.310738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11c74d-de95-4003-9e6b-21686e546e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.312070 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11c74d-de95-4003-9e6b-21686e546e08 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.312565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11c74d-de95-4003-9e6b-21686e546e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.313064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11c74d-de95-4003-9e6b-21686e546e08 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.313830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.314662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.314940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.315257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.323552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.325819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11c74d-de95-4003-9e6b-21686e546e08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:38.325928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.333434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5a11c74d-de95-4003-9e6b-21686e546e08 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:38.335657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 267/528] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.336707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11c74d-de95-4003-9e6b-21686e546e08 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.339555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:38.346406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 262/529] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.347454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.356200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11c74d-de95-4003-9e6b-21686e546e08 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.360771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.361661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.361782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d04336-b828-4005-a033-1037ce60cf2f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.362327 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.362812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.363972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.364582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.366830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.367470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.367770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.368093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.368525 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.368820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.369167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.371042 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.381221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 263/530] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.381923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 268/531] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.382044 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.387918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.395508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2013a-2c4c-4cf7-93ce-b67485be32ee admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.398151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b455-bf79-490f-8051-88375305c13f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.400522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.401162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.401439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.401712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.402487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.402790 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.403060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.403989 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.404343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.404657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.404757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.412137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.415178 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.422358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 264/532] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.423233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.430130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:38.431654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 269/533] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.432872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04c37e-7eb3-4fa3-a244-5bdafa319b5d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.437798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.441630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.442618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.443111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.443774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.449112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2df9-13c2-4d6a-a067-0406f50a5a4f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.453319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.453942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.454219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.454486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.455776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=dbe34d9bb0994e7f80044be0a373ed5e) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.456089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.458628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.459250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.461934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.471815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 270/534] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/role_assignments?user.id=dbe34d9bb0994e7f80044be0a373ed5e&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.472995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.488659 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0ca7-c4cc-45b4-9727-89596128410d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.490188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:38.495353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.496667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.497267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.497856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.499037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.499509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.501576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.504177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 265/535] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.510995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.517770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 271/536] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.525933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.534071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a7ca-047e-4fb0-b7a3-a979a430c8ed admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.536583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5512cb8-a9a8-4e22-8b83-2e487e691819 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.542093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.543025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.543450 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.543890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.545222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=b8eb54ff54264f309aa5949ed8aef453) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.545684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.547785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.549027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.549719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.550004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.550282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.551023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.551328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.552993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.556451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 272/537] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/role_assignments?user.id=b8eb54ff54264f309aa5949ed8aef453&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.583303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 266/538] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:38.590756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.607827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47724a-ab1c-4658-95e7-0afcef385982 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.612749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc55da-702f-4a16-8aa4-8e25c6e4872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.613575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc55da-702f-4a16-8aa4-8e25c6e4872c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.613856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc55da-702f-4a16-8aa4-8e25c6e4872c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.614205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc55da-702f-4a16-8aa4-8e25c6e4872c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.633351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc55da-702f-4a16-8aa4-8e25c6e4872c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.635509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc55da-702f-4a16-8aa4-8e25c6e4872c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.654145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-96dc55da-702f-4a16-8aa4-8e25c6e4872c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:25:38.655628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 273/539] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.661916 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.682216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f9879-9d09-4cb3-9cf0-096c346fa228 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.692129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.693065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.693512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.694603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.695614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.696084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.698106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.700782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f9d37-58a7-4e1d-a067-e73ec10d9fb7 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.701199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f9d37-58a7-4e1d-a067-e73ec10d9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.702324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f9d37-58a7-4e1d-a067-e73ec10d9fb7 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.703576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 274/540] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:38.711825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae805e1-2b2f-4cf3-8a9d-cbc069f06bc8 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.712272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae805e1-2b2f-4cf3-8a9d-cbc069f06bc8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.712668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae805e1-2b2f-4cf3-8a9d-cbc069f06bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.720869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 267/541] 10.222.0.16 () {56 vars in 1159 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.728063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.737776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0cc39-d8c7-487c-b699-acc987a6a47e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.742539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad3a2c-d473-418f-80d2-a164c4f80ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.743422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3a2c-d473-418f-80d2-a164c4f80ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.743872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3a2c-d473-418f-80d2-a164c4f80ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.743995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-5ae805e1-2b2f-4cf3-8a9d-cbc069f06bc8 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:38.744391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3a2c-d473-418f-80d2-a164c4f80ac9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.745161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5ae805e1-2b2f-4cf3-8a9d-cbc069f06bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:38.753243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad3a2c-d473-418f-80d2-a164c4f80ac9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.755295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad3a2c-d473-418f-80d2-a164c4f80ac9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.756854 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 275/542] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:38.765068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 268/543] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:38.771244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae805e1-2b2f-4cf3-8a9d-cbc069f06bc8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.783641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad3a2c-d473-418f-80d2-a164c4f80ac9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.783873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae805e1-2b2f-4cf3-8a9d-cbc069f06bc8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.789115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.790323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.790641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.791049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.796804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad3a2c-d473-418f-80d2-a164c4f80ac9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.802609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42ae1-f348-4876-a861-228925d8d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.803778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.804327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42ae1-f348-4876-a861-228925d8d30d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.804748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42ae1-f348-4876-a861-228925d8d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.805156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42ae1-f348-4876-a861-228925d8d30d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.805626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.823645 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:38.825185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 276/544] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.826698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb42ae1-f348-4876-a861-228925d8d30d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:38.831193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.833785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-6eb42ae1-f348-4876-a861-228925d8d30d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:38.835232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 269/545] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:38.843008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42ae1-f348-4876-a861-228925d8d30d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.851287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4605d-d7b3-4b47-a710-0fb938d14ea4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.855368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42ae1-f348-4876-a861-228925d8d30d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.856622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.857283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.857568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.857893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.858565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.858865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.860495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.861537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.862673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.863684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.864219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.865174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.866422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.869006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.874400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 277/546] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:38.886189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.886373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 270/547] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:38.891352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.899788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe78fc-f5a6-4b88-9aca-c04baa71fd3a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.904698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aae54e-9eac-488f-8911-59ca8139387c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.905137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.906374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.906906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.907384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.909892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.911076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.911391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.911828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.916763 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.919107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.924106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.926537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.936596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:38.938573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 278/548] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:38.946317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.954283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:38.955462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06a610-32db-445d-ba8a-d1dcb3fb549d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.956882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 271/549] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:38.961428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.961428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.961428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.961428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.961935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.962217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.964372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.965512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.977855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 279/550] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:38.979112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8b9ac-6797-4050-b05f-24376178e4cc admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.984134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:38.986608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.987545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.988109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:38.988866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:38.991066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:38.992512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:38.994173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9971cba-c60f-468f-a810-9ff778c15d93 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:38.994577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:38.998726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:38.999373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:38.999760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.000044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.000932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=a02f0a6cbe5442da8bd2f78643d31aba) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.001290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.003297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.011024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 280/551] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/role_assignments?user.id=a02f0a6cbe5442da8bd2f78643d31aba&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:39.011383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 272/552] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:39.029519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.050426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41652d7-7b53-4a1d-a598-6ebc9657fd82 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.059030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.060073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.060540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.060946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.081288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.083579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.105113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:25:39.106869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 281/553] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/users/neutron => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:39.117475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.136647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df53bb-59ff-42dc-84b8-f4fdbcbec5d2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.147538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.149129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.149550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.149987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.150967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.151410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.153430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.180674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 273/554] 10.222.0.16 () {56 vars in 1161 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:39.187336 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.204068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bbc3-e09b-489e-ac8f-959913bd45dd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.211812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e810c8-2da3-4ad4-8448-f8c3db8870cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.212733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e810c8-2da3-4ad4-8448-f8c3db8870cc admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.213204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e810c8-2da3-4ad4-8448-f8c3db8870cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.214002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e810c8-2da3-4ad4-8448-f8c3db8870cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.228649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e810c8-2da3-4ad4-8448-f8c3db8870cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.230682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e810c8-2da3-4ad4-8448-f8c3db8870cc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.246780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 282/555] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:39.253606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.270202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d22db-d5c8-4495-9fa0-117a07341332 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.276860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.278106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.278642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.279156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.291111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.293401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.313462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ca83-2d3f-4630-bab1-1364a553a8ef None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.313884 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ca83-2d3f-4630-bab1-1364a553a8ef None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.314331 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ca83-2d3f-4630-bab1-1364a553a8ef None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.315948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:39.316643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 283/556] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:39.317482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 274/557] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:39.324294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb9db-08e7-4919-af23-669416c05ab3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.324752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb9db-08e7-4919-af23-669416c05ab3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.325255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb9db-08e7-4919-af23-669416c05ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.327570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.337750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668486d2-23e1-4f4b-a104-50b5df0abd25 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.342658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.343544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.344009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.344443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.345335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.345783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.347581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.351604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-32ccb9db-08e7-4919-af23-669416c05ab3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:39.352823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-32ccb9db-08e7-4919-af23-669416c05ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:39.362343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 284/558] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:39.363324 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 275/559] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:39.370596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccb9db-08e7-4919-af23-669416c05ab3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.379262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccb9db-08e7-4919-af23-669416c05ab3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.386204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.387029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.387308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.387578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.394158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.395593 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.398861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.405017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbe142-5dfd-4b5b-bc6f-c92cbb97a409 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.409726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdf5a4-7948-43ec-a9fe-06c8106e9e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.410745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdf5a4-7948-43ec-a9fe-06c8106e9e9d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.411205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdf5a4-7948-43ec-a9fe-06c8106e9e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.411655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdf5a4-7948-43ec-a9fe-06c8106e9e9d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.413457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:39.414667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 285/560] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:39.421008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.423679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdf5a4-7948-43ec-a9fe-06c8106e9e9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:39.431811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e34c49-317d-4f5e-89da-11c8ced5f3b9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.432421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-efbdf5a4-7948-43ec-a9fe-06c8106e9e9d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:39.434330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 276/561] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:39.440667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.441213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdf5a4-7948-43ec-a9fe-06c8106e9e9d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.441440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.441894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.442195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.443214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.443583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.446988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.455177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdf5a4-7948-43ec-a9fe-06c8106e9e9d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.461388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.462328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.462828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.463261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.463922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 286/562] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:39.464725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.465224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.467208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.468414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.478105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3dbb2-31d5-4d3d-8116-2cbe708f5b47 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.478333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 277/563] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:39.484898 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.486528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.487385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.487863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.488328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.489338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=78279cb4fa504d18943cd8807b674cf9) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.489821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.492385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.496681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aadd22-7f57-4e6a-86d3-f5b860c7370c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.501454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.501679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 287/564] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/role_assignments?user.id=78279cb4fa504d18943cd8807b674cf9&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:39.502559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.502943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.503328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.516308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.518362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.538320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:39.539891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 278/565] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:39.547181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.557883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64bb62-0c2d-4043-a9c2-a2facd08ab4f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.562519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.563205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.563547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.563913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.564668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.565024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.566739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.582304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 288/566] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:39.589340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.599397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aa804-d98c-47c0-9921-913605b86db5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.604980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.605903 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.606183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.606495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.615309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.618029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.633516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:25:39.634991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 279/567] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:39.641699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.652503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2feb45-0316-42ad-bf0c-a8b4ea8c563c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.657228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.658057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.658349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.658634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.659535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.659885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.661835 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.682697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 289/568] 10.222.0.16 () {56 vars in 1157 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:39.688918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.698706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc875c-3e9c-4850-a334-f806dc75e06a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.703886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.704804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.705148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.705681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.718815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.720927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.738875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:39.740079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 280/569] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:39.747588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.761203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418d86-db63-4212-9b4b-dbaa4f75b45e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.766601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.767263 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.767539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.767845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.768577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.768877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.770482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.784235 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 290/570] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:39.793885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.805831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759999ad-710a-4cc3-b7a1-1a787c06dc15 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.810465 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.811587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.812087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.812587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.823634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.825976 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.840554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:39.842336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 281/571] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:39.848809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.858772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0fd6a-1929-4134-952d-02a64e269ee7 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.863323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa8020-c79d-4e3b-b45c-0d7b3a61517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.864333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8020-c79d-4e3b-b45c-0d7b3a61517e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.864836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8020-c79d-4e3b-b45c-0d7b3a61517e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.865356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8020-c79d-4e3b-b45c-0d7b3a61517e admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.867315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8020-c79d-4e3b-b45c-0d7b3a61517e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:39.867918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8020-c79d-4e3b-b45c-0d7b3a61517e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.870019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8020-c79d-4e3b-b45c-0d7b3a61517e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.885796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 291/572] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:39.892460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:39.903657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0641f-f099-4eef-999b-3854d4b4bfcb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:39.908595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe949-3648-448a-851a-c4cb4bab66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:39.909749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe949-3648-448a-851a-c4cb4bab66d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:39.910271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe949-3648-448a-851a-c4cb4bab66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:39.910763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe949-3648-448a-851a-c4cb4bab66d8 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/7195fd0ceaf6413d80120c47b3c86358/roles/2b4c5582fd5d417996790d0ed9464d51` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:39.927528 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe949-3648-448a-851a-c4cb4bab66d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=7195fd0ceaf6413d80120c47b3c86358, role_id=2b4c5582fd5d417996790d0ed9464d51)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:39.931271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe949-3648-448a-851a-c4cb4bab66d8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:39.946612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 282/573] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:39 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/7195fd0ceaf6413d80120c47b3c86358/roles/2b4c5582fd5d417996790d0ed9464d51 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:41.201074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b523f8-f3b9-4083-b768-e49c54c95084 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.201590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b523f8-f3b9-4083-b768-e49c54c95084 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.201663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b523f8-f3b9-4083-b768-e49c54c95084 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.203395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 292/574] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:41.210184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa430fe-1ebb-429a-95cb-4f9ffbd51c77 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.210767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa430fe-1ebb-429a-95cb-4f9ffbd51c77 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.210855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa430fe-1ebb-429a-95cb-4f9ffbd51c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.233379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-eaa430fe-1ebb-429a-95cb-4f9ffbd51c77 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:41.234556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-eaa430fe-1ebb-429a-95cb-4f9ffbd51c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:41.314874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 283/575] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:41.365262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b523f8-f3b9-4083-b768-e49c54c95084 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.381766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b523f8-f3b9-4083-b768-e49c54c95084 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.386065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2fd46-9bb8-4374-b608-779e8e0c096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.386856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2fd46-9bb8-4374-b608-779e8e0c096d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.387135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2fd46-9bb8-4374-b608-779e8e0c096d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.387403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2fd46-9bb8-4374-b608-779e8e0c096d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.402878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2fd46-9bb8-4374-b608-779e8e0c096d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:41.409607 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-bcd2fd46-9bb8-4374-b608-779e8e0c096d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:41.410808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 293/576] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:41.414177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434fbca-11e6-464f-88f7-74592c2c8656 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.414466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434fbca-11e6-464f-88f7-74592c2c8656 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.414752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434fbca-11e6-464f-88f7-74592c2c8656 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.416555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 284/577] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:41.420640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2fd46-9bb8-4374-b608-779e8e0c096d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.422519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60fe1-8b9c-43aa-a91b-84ec715d64c4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.422967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60fe1-8b9c-43aa-a91b-84ec715d64c4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.423380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60fe1-8b9c-43aa-a91b-84ec715d64c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.433264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2fd46-9bb8-4374-b608-779e8e0c096d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.438103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.438770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.439056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.439332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.440102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:41.440408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.442024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.443289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-cee60fe1-8b9c-43aa-a91b-84ec715d64c4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:41.444719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cee60fe1-8b9c-43aa-a91b-84ec715d64c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:41.456700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 285/578] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:41.466198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 294/579] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:41.472212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee60fe1-8b9c-43aa-a91b-84ec715d64c4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.481810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee60fe1-8b9c-43aa-a91b-84ec715d64c4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.491804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.493211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.500476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.501074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.502889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627eff-7a70-4ad3-814d-7bf0f4f03c40 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.504120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.513280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.514256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.514695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.515105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.515255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.519739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.531284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.533408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.538636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:41.538636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 286/580] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:41.543994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.553543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83900c25-0d81-4b2b-9f00-51ac7656b4e7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.562344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:41.563901 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 295/581] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:41.570364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.571700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.574858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.575150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.575428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.576200 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:41.576505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.579866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.586729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0da6c-a556-40d1-8407-e56e301e4f02 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.597495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.598583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.598869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.599144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.601546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:41.601873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.603790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.610204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 287/582] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:41.624226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 296/583] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:41.625126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.630844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.640547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b2fca-ab89-4b99-81d6-dc0642cada9b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.644828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ea82c-8da7-4584-bc2b-29a5e84b2745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.645646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ea82c-8da7-4584-bc2b-29a5e84b2745 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.645929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ea82c-8da7-4584-bc2b-29a5e84b2745 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.646209 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ea82c-8da7-4584-bc2b-29a5e84b2745 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.647026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ea82c-8da7-4584-bc2b-29a5e84b2745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.649025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ea82c-8da7-4584-bc2b-29a5e84b2745 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.649930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf735ba-70f6-456e-93d3-8e6e348f1f6e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.668404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.669215 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.669498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.669774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.672083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 297/584] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:25:41 2021] POST /identity/v3/users => generated 254 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:25:41.688826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.690892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.711460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:25:41.716441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 288/585] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:41.723517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ea82c-8da7-4584-bc2b-29a5e84b2745 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.740014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ea82c-8da7-4584-bc2b-29a5e84b2745 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.747733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.748417 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.748698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.748976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.749829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:41.750139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.752048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.790205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 298/586] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:41.796847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.808909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397dcac-7490-47b9-a628-d9e8e29d7815 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.817838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3c719-26d1-40cc-8d8a-be5081735fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.818510 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3c719-26d1-40cc-8d8a-be5081735fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.819345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3c719-26d1-40cc-8d8a-be5081735fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.819690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3c719-26d1-40cc-8d8a-be5081735fb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.832049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3c719-26d1-40cc-8d8a-be5081735fb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.833845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3c719-26d1-40cc-8d8a-be5081735fb7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.849707 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 289/587] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:41.856424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.869345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286216-4385-4a4e-9a4d-b29e8e7f4fb7 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.878176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.878985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.879268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.879540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.896700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.898518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.919130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:41.920387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 299/588] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:41.926585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3c719-26d1-40cc-8d8a-be5081735fb7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.936395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3c719-26d1-40cc-8d8a-be5081735fb7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.943069 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.943967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.944345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.944622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.945351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:41.945655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:41.947273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:41.962404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 290/589] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:41.968834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:41.980219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa8f7b-cf19-409a-99f2-b50ce9fbca2a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:41.987929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:41.988727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:41.989008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:41.989286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:41.999584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.001596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.017744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:42.019270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 300/590] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:42.026734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.050820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d69c0-ce29-4f43-90e5-802ae292f3ea admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.061110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5905e-8697-441b-832e-6014c7978f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.061796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5905e-8697-441b-832e-6014c7978f23 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.062116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5905e-8697-441b-832e-6014c7978f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.062389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5905e-8697-441b-832e-6014c7978f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.063199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5905e-8697-441b-832e-6014c7978f23 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:42.063553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5905e-8697-441b-832e-6014c7978f23 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.065522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5905e-8697-441b-832e-6014c7978f23 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.079840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 291/591] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:42.089601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.099424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02048b37-7dcb-4bea-a8bc-6d5dd270610e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.106643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ec4f-39ec-40ae-9405-01ea1a763cad None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.106643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ec4f-39ec-40ae-9405-01ea1a763cad None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.106643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ec4f-39ec-40ae-9405-01ea1a763cad None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.107406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 292/592] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:42.112546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.113531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.113657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed16cd-3fc4-4892-87dc-42c89d0062df None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.113862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.113966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed16cd-3fc4-4892-87dc-42c89d0062df None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.114164 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.114265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed16cd-3fc4-4892-87dc-42c89d0062df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.115082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=dbe34d9bb0994e7f80044be0a373ed5e) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:42.116020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.123263 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.129824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 301/593] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/role_assignments?user.id=dbe34d9bb0994e7f80044be0a373ed5e&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:42.149829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8aed16cd-3fc4-4892-87dc-42c89d0062df None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:42.150963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8aed16cd-3fc4-4892-87dc-42c89d0062df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:42.159529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 293/594] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:42.194757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.208154 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588da3e-7cdb-40cb-9dff-c0efb4930217 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.213816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.214691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.214976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.215283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.215974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.217037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:42.217037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:42.217037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:42.217977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.236125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:25:42.237780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 302/595] 10.222.0.16 () {56 vars in 1151 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:42.244893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed16cd-3fc4-4892-87dc-42c89d0062df None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.254007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed16cd-3fc4-4892-87dc-42c89d0062df None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.258854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e600c9-b589-48f2-a571-af54cc23055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.259541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e600c9-b589-48f2-a571-af54cc23055f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.259849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e600c9-b589-48f2-a571-af54cc23055f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.260124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e600c9-b589-48f2-a571-af54cc23055f admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.260844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e600c9-b589-48f2-a571-af54cc23055f admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:42.261255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e600c9-b589-48f2-a571-af54cc23055f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.262339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-71e600c9-b589-48f2-a571-af54cc23055f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:42.262339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:42.262339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:42.263253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e600c9-b589-48f2-a571-af54cc23055f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.273629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 294/596] 10.222.0.16 () {56 vars in 1146 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:42.280097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.291385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd1783-8c0d-453c-ba29-c4ebc3b91381 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.300368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af95ba-d567-4bfb-aa26-978f70c059ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.301175 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af95ba-d567-4bfb-aa26-978f70c059ad admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.301462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af95ba-d567-4bfb-aa26-978f70c059ad admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.301742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af95ba-d567-4bfb-aa26-978f70c059ad admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.302597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af95ba-d567-4bfb-aa26-978f70c059ad admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:42.302912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af95ba-d567-4bfb-aa26-978f70c059ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.304692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-00af95ba-d567-4bfb-aa26-978f70c059ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:42.304692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:42.304692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:42.305753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af95ba-d567-4bfb-aa26-978f70c059ad admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.313105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 303/597] 10.222.0.16 () {56 vars in 1146 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:42.348943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803685af-da8d-4a7f-bc83-9e57bd2b1824 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.349308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803685af-da8d-4a7f-bc83-9e57bd2b1824 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.349493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803685af-da8d-4a7f-bc83-9e57bd2b1824 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.352335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 295/598] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:42.358838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483f7b-e4a9-4a3e-bc01-3a88a5932cb8 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.359203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483f7b-e4a9-4a3e-bc01-3a88a5932cb8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.359494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483f7b-e4a9-4a3e-bc01-3a88a5932cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.380109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c7483f7b-e4a9-4a3e-bc01-3a88a5932cb8 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:42.381348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c7483f7b-e4a9-4a3e-bc01-3a88a5932cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:42.389737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 304/599] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:42.426650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803685af-da8d-4a7f-bc83-9e57bd2b1824 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.439739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803685af-da8d-4a7f-bc83-9e57bd2b1824 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.444232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.445098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.445384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.445659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] PATH_INFO: `/v3/services/network` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.446329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.447604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:42.447604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:42.447604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:42.448641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.462569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:25:42.464378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 296/600] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:42.470636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483f7b-e4a9-4a3e-bc01-3a88a5932cb8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.480386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483f7b-e4a9-4a3e-bc01-3a88a5932cb8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.484865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80167-d931-446d-a085-9fcff70f2d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.485550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80167-d931-446d-a085-9fcff70f2d57 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.485856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80167-d931-446d-a085-9fcff70f2d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.486108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80167-d931-446d-a085-9fcff70f2d57 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.486837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80167-d931-446d-a085-9fcff70f2d57 admin admin] RBAC: Adding query filter params (name=network) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:42.487144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80167-d931-446d-a085-9fcff70f2d57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.488817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80167-d931-446d-a085-9fcff70f2d57 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.499478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 305/601] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:42.505389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.515375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ce39e-c2bd-45dd-9960-5849ff7c1ab2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.519624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2c2f5-be8b-412c-af45-6190d7fd3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.520320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c2f5-be8b-412c-af45-6190d7fd3168 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.520620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c2f5-be8b-412c-af45-6190d7fd3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.520881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c2f5-be8b-412c-af45-6190d7fd3168 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.521595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2c2f5-be8b-412c-af45-6190d7fd3168 admin admin] RBAC: Adding query filter params (type=network) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:42.522387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2c2f5-be8b-412c-af45-6190d7fd3168 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.524191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2c2f5-be8b-412c-af45-6190d7fd3168 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.530497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 297/602] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/services?type=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:42.788849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0cc7-5a31-4965-a88f-55eff4e11255 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.789508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0cc7-5a31-4965-a88f-55eff4e11255 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.790003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0cc7-5a31-4965-a88f-55eff4e11255 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.792029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 306/603] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:42.798252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec2a69-0204-45b1-a3f3-46e372d3a39d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.798772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec2a69-0204-45b1-a3f3-46e372d3a39d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.799294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec2a69-0204-45b1-a3f3-46e372d3a39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.817431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-a9ec2a69-0204-45b1-a3f3-46e372d3a39d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:42.818940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a9ec2a69-0204-45b1-a3f3-46e372d3a39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:42.826153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 298/604] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:42.851779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f0cc7-5a31-4965-a88f-55eff4e11255 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.863638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f0cc7-5a31-4965-a88f-55eff4e11255 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.868145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e2cb8-32e8-4152-b952-c8cdbf058b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.869191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e2cb8-32e8-4152-b952-c8cdbf058b89 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.869696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e2cb8-32e8-4152-b952-c8cdbf058b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.870163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e2cb8-32e8-4152-b952-c8cdbf058b89 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.880946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e2cb8-32e8-4152-b952-c8cdbf058b89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:42.888063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-d36e2cb8-32e8-4152-b952-c8cdbf058b89 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:42.889926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 307/605] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:42.896559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec2a69-0204-45b1-a3f3-46e372d3a39d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.907566 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec2a69-0204-45b1-a3f3-46e372d3a39d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.912219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.913766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.914267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.914740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.915696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:42.916221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.918005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.927271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 299/606] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:42.933718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e2cb8-32e8-4152-b952-c8cdbf058b89 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:42.945753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e2cb8-32e8-4152-b952-c8cdbf058b89 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:42.950483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:42.951587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:42.952088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:42.952605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:42.969523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:42.971793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:42.993973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:42.995828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 308/607] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:43.002142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.012245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aa856-70cf-4956-99fc-baa49b40ad7c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.016876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.017824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.018308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.018801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.019768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:43.020271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.022766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.035822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 300/608] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:43.043100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.053635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0ddc-d807-42a3-9aa6-c667cd28fc27 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.062695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.063836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.064321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.064843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.079495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.082047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.099303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:25:43.101494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 309/609] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:43.107670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.129759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1228aa-17b9-4ebe-96be-9b41540e9a27 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.137449 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.138439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.138954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.139429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.140537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:43.141078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.143182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.171647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 301/610] 10.222.0.16 () {56 vars in 1157 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:43.178464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.202083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535fad-d0e5-4d70-be95-df8d6ccecfe1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.217316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7f5cb-16c1-472a-9599-dd166b1cf355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.217986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7f5cb-16c1-472a-9599-dd166b1cf355 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.218246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7f5cb-16c1-472a-9599-dd166b1cf355 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.218521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7f5cb-16c1-472a-9599-dd166b1cf355 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.230299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7f5cb-16c1-472a-9599-dd166b1cf355 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.232110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7f5cb-16c1-472a-9599-dd166b1cf355 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.246231 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 310/611] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:43.247759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.263086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3020d04-dfb2-4031-8bb7-5e9b3b811cae admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.270380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.271541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.272249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.272745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.288776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.291080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.319448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:43.321247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 302/612] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:43.328296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7f5cb-16c1-472a-9599-dd166b1cf355 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.346125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7f5cb-16c1-472a-9599-dd166b1cf355 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.351433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.352150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.352521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.352803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.353534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:43.353841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.355450 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.377307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 311/613] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:43.384213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.402291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b355d1-7f65-48a2-bd01-fa01e215a5ae admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.409470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.411635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.412256 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.413562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.424756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.427160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.444382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:43.446301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 303/614] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:43.453021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.469201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b3bda-e7a7-48b5-9ac6-63e828a8ea6e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.473701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d58381-a2f3-4f96-9451-2a8caea627cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.474367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58381-a2f3-4f96-9451-2a8caea627cc admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.474647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58381-a2f3-4f96-9451-2a8caea627cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.474975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d58381-a2f3-4f96-9451-2a8caea627cc admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.484267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d58381-a2f3-4f96-9451-2a8caea627cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:43.484583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d58381-a2f3-4f96-9451-2a8caea627cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.486495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d58381-a2f3-4f96-9451-2a8caea627cc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.507115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 312/615] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:43.513961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:43.532765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609fba-bf68-40f3-92e4-3df1d775e118 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:43.540890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362669-74e9-4fa6-adcc-7384e282d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:43.541855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362669-74e9-4fa6-adcc-7384e282d704 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:43.542373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362669-74e9-4fa6-adcc-7384e282d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:43.542899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362669-74e9-4fa6-adcc-7384e282d704 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:43.544062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362669-74e9-4fa6-adcc-7384e282d704 admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=7195fd0ceaf6413d80120c47b3c86358) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:43.544731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362669-74e9-4fa6-adcc-7384e282d704 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:43.546913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362669-74e9-4fa6-adcc-7384e282d704 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:43.560991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 304/616] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:43 2021] GET /identity/v3/role_assignments?user.id=7195fd0ceaf6413d80120c47b3c86358&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:44.424928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819acab-ff5c-46b3-997b-0ee543bee734 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.425403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819acab-ff5c-46b3-997b-0ee543bee734 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.425403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819acab-ff5c-46b3-997b-0ee543bee734 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.427178 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 313/617] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:44.446717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49209-f8e9-449e-98b6-48fb7341e360 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.447232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49209-f8e9-449e-98b6-48fb7341e360 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.447461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49209-f8e9-449e-98b6-48fb7341e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.468538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-02e49209-f8e9-449e-98b6-48fb7341e360 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:44.469735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-02e49209-f8e9-449e-98b6-48fb7341e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:44.477180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 305/618] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:44.524406 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819acab-ff5c-46b3-997b-0ee543bee734 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.536171 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819acab-ff5c-46b3-997b-0ee543bee734 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.540953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601743fe-3a47-49be-bcaa-89f626e03031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.541750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601743fe-3a47-49be-bcaa-89f626e03031 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.542034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601743fe-3a47-49be-bcaa-89f626e03031 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.542308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601743fe-3a47-49be-bcaa-89f626e03031 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.553101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601743fe-3a47-49be-bcaa-89f626e03031 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:44.559935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-601743fe-3a47-49be-bcaa-89f626e03031 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:44.561492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 314/619] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:44.567547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e49209-f8e9-449e-98b6-48fb7341e360 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.576858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e49209-f8e9-449e-98b6-48fb7341e360 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.581052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.581717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.581999 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.582275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.583013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:44.583315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:44.585229 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:44.599335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 306/620] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:44.605838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601743fe-3a47-49be-bcaa-89f626e03031 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.616559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601743fe-3a47-49be-bcaa-89f626e03031 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.625163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.625962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.626233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.626502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.637979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:44.639881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:44.662963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:44.664606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 315/621] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:44.670416 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.685950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a8fc-39ac-4b2a-bcb2-ea572b5419bc admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.690104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.690771 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.691050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.691326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.692084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:44.692387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:44.694511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:44.710832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 307/622] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:44.716982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.727099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4516a6e-eb01-4258-bde8-c1bd75624c95 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.735507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.736342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.736620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.736895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.745086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:44.747115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:44.772066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:25:44.773542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 316/623] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:44.779854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.793249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b8372-b4cb-4ec7-9272-1b73f52b6655 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.797595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c609bd-c2c9-434f-b9b2-17054d143cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.798278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c609bd-c2c9-434f-b9b2-17054d143cea admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.798562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c609bd-c2c9-434f-b9b2-17054d143cea admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.798841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c609bd-c2c9-434f-b9b2-17054d143cea admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.799688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c609bd-c2c9-434f-b9b2-17054d143cea admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:44.800026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c609bd-c2c9-434f-b9b2-17054d143cea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:44.801863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c609bd-c2c9-434f-b9b2-17054d143cea admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:44.831211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 308/624] 10.222.0.16 () {56 vars in 1171 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:44.837534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.853291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251e707-2327-43c1-83c3-8d0d08c55ac0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.863237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95ebc-521c-488d-9e9c-5f53b404dcfa None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.863621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95ebc-521c-488d-9e9c-5f53b404dcfa None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.863932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95ebc-521c-488d-9e9c-5f53b404dcfa None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.864105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa77c-d45b-42b1-b1bc-f90862fd0f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.864717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa77c-d45b-42b1-b1bc-f90862fd0f45 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.865001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa77c-d45b-42b1-b1bc-f90862fd0f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.865305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa77c-d45b-42b1-b1bc-f90862fd0f45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.866125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 309/625] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:44.872276 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8e5b7-75eb-4942-bdcd-aa24df1eaba4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.873163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8e5b7-75eb-4942-bdcd-aa24df1eaba4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.873451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8e5b7-75eb-4942-bdcd-aa24df1eaba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.877086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa77c-d45b-42b1-b1bc-f90862fd0f45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:44.878857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa77c-d45b-42b1-b1bc-f90862fd0f45 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:44.892877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 317/626] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:44.900371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b2d8e5b7-75eb-4942-bdcd-aa24df1eaba4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:44.900749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa77c-d45b-42b1-b1bc-f90862fd0f45 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.901534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b2d8e5b7-75eb-4942-bdcd-aa24df1eaba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:44.909109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa77c-d45b-42b1-b1bc-f90862fd0f45 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.913436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 310/627] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:44.924357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.925156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.925432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.925701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.934352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8e5b7-75eb-4942-bdcd-aa24df1eaba4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.936747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:44.938739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:44.946592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8e5b7-75eb-4942-bdcd-aa24df1eaba4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.963357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:44.965602 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb193d2-a800-4a91-b71f-07fd92fe07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:44.966393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb193d2-a800-4a91-b71f-07fd92fe07f6 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:44.966671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb193d2-a800-4a91-b71f-07fd92fe07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:44.966946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb193d2-a800-4a91-b71f-07fd92fe07f6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:44.974138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 318/628] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:44.979379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb193d2-a800-4a91-b71f-07fd92fe07f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:44.984709 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:44.992240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-6eb193d2-a800-4a91-b71f-07fd92fe07f6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:44.994798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 311/629] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:44.998147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ad006-039e-4b8f-8b7f-f27bc93b6433 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:44.999928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb193d2-a800-4a91-b71f-07fd92fe07f6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.007965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.008631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.008909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.009184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.009913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:45.010219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.011857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.016619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb193d2-a800-4a91-b71f-07fd92fe07f6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.026751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.027419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.028966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.029245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.030000 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:45.030713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.032918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.036856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 319/630] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:45.044293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.054929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 312/631] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:45.055329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157e64-9f5e-43cf-9066-3031f9bc4daf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.059748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.061367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.066218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.066509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.066788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.073155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f1e4-6e69-494c-94d7-abfc8c068a1b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.082250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.083122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.084829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.086662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.086964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.087662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.113460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:45.114896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 320/632] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:45.116560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.118473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.122323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.138808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962af1a1-27a0-4bd4-9dca-d0a04b6dd900 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.143226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08028568-1f7a-4b8d-9d4c-3485bd67dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.143920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08028568-1f7a-4b8d-9d4c-3485bd67dfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.144194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:45.144370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08028568-1f7a-4b8d-9d4c-3485bd67dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.144559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08028568-1f7a-4b8d-9d4c-3485bd67dfd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.145348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08028568-1f7a-4b8d-9d4c-3485bd67dfd1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:45.145710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08028568-1f7a-4b8d-9d4c-3485bd67dfd1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.147849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08028568-1f7a-4b8d-9d4c-3485bd67dfd1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.151860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 313/633] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:45.158491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.171422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f598-653d-42aa-899a-54fe6095bc15 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.171755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 321/634] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:45.173014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd156b-0ccc-4384-82c0-a7ce3915db68 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.173278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd156b-0ccc-4384-82c0-a7ce3915db68 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.173559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd156b-0ccc-4384-82c0-a7ce3915db68 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.175739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 322/635] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:45.177256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd156b-0ccc-4384-82c0-a7ce3915db68 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.181895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10ce8c-0299-4f32-86cf-669ab0bb7128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.182570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ce8c-0299-4f32-86cf-669ab0bb7128 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.182900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ce8c-0299-4f32-86cf-669ab0bb7128 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.183178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ce8c-0299-4f32-86cf-669ab0bb7128 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.184031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10ce8c-0299-4f32-86cf-669ab0bb7128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:45.184336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10ce8c-0299-4f32-86cf-669ab0bb7128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.186011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10ce8c-0299-4f32-86cf-669ab0bb7128 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.192328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd156b-0ccc-4384-82c0-a7ce3915db68 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.198688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 314/636] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:45.199787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.200136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5513c2a-f713-4d69-9642-665a3d493f32 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.200403 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5513c2a-f713-4d69-9642-665a3d493f32 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.200676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5513c2a-f713-4d69-9642-665a3d493f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.201438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.202031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.202600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.203771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=e17902fcace54636bd031101c4672759) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:45.204328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.206762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.218925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 323/637] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/role_assignments?user.id=e17902fcace54636bd031101c4672759&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:45.219956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-a5513c2a-f713-4d69-9642-665a3d493f32 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:45.220479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.221100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a5513c2a-f713-4d69-9642-665a3d493f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:45.229941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 315/638] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:45.232537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5ee4-925a-4dc8-b268-ca4b5139e0cf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.237390 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.238512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.239070 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.239565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.249166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.251642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.253579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5513c2a-f713-4d69-9642-665a3d493f32 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.262859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5513c2a-f713-4d69-9642-665a3d493f32 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.267153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.267852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.268130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.268396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.269116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.270151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:45.270151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:45.270151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:45.270935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:25:45.271041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.272710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 324/639] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:45.279199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.289815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a2b1-e4a1-4a25-b2d9-85fc62c37c2c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.290122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 316/640] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:25:45 2021] POST /identity/v3/services => generated 240 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:25:45.328091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.329277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.329823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.330336 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.331501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:45.332071 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.334473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.359820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 325/641] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:45.367166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.383851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778caa-8d95-41cc-8910-802d93117154 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.397652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaf378-3b3e-45ac-81a8-f4649a8a8ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.398471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf378-3b3e-45ac-81a8-f4649a8a8ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.398813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf378-3b3e-45ac-81a8-f4649a8a8ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.399086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf378-3b3e-45ac-81a8-f4649a8a8ae8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.416796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaf378-3b3e-45ac-81a8-f4649a8a8ae8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.418686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaf378-3b3e-45ac-81a8-f4649a8a8ae8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.436879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-59eaf378-3b3e-45ac-81a8-f4649a8a8ae8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:45.438465 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 317/642] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:45.445503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.462318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e694a8-1e9a-49db-ad15-a9123ae31f59 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.463227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6778-ff9b-4ce5-9c69-e6587488d6a5 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.463979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6778-ff9b-4ce5-9c69-e6587488d6a5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.464262 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6778-ff9b-4ce5-9c69-e6587488d6a5 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.466539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 318/643] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:45.470565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.471845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.472283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.472706 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.473373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40f028-79e9-4bba-9c57-7195d2147d1d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.473765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40f028-79e9-4bba-9c57-7195d2147d1d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.474003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:45.474228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40f028-79e9-4bba-9c57-7195d2147d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.474660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.477077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.502389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 326/644] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:45.507412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1f40f028-79e9-4bba-9c57-7195d2147d1d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:45.509699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.511031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1f40f028-79e9-4bba-9c57-7195d2147d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:45.523366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a23be-17e3-43fc-86e6-752e8854ff4b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.528436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 319/645] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:45 2021] POST /identity/v3/auth/tokens => generated 1166 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:45.537012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.538381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.538663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.538938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.546522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.548530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.553709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40f028-79e9-4bba-9c57-7195d2147d1d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.562389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40f028-79e9-4bba-9c57-7195d2147d1d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.563579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:45.566749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c98a4-b28e-41cf-97d7-1a679bad95d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.567519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c98a4-b28e-41cf-97d7-1a679bad95d3 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.567862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c98a4-b28e-41cf-97d7-1a679bad95d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.568143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c98a4-b28e-41cf-97d7-1a679bad95d3 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.569444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c98a4-b28e-41cf-97d7-1a679bad95d3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.570562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 327/646] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:45.571114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c98a4-b28e-41cf-97d7-1a679bad95d3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.571774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.581057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed70c7-eda3-4c8f-a992-6a913e145446 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.585787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ddf68-055e-4a42-83bf-f1e1fab54c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.586501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ddf68-055e-4a42-83bf-f1e1fab54c89 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.586783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ddf68-055e-4a42-83bf-f1e1fab54c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.587060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ddf68-055e-4a42-83bf-f1e1fab54c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.587982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ddf68-055e-4a42-83bf-f1e1fab54c89 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:45.588293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ddf68-055e-4a42-83bf-f1e1fab54c89 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.590423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 320/647] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:25:45 2021] POST /identity/v3/services => generated 251 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:25:45.590949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ddf68-055e-4a42-83bf-f1e1fab54c89 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.615088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 328/648] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:45.616717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c98a4-b28e-41cf-97d7-1a679bad95d3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:45.637643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c98a4-b28e-41cf-97d7-1a679bad95d3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:45.642191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd695c91-6dc8-41ee-92ef-2fa9d1e0b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:45.643174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd695c91-6dc8-41ee-92ef-2fa9d1e0b105 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:45.643510 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd695c91-6dc8-41ee-92ef-2fa9d1e0b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:45.643817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd695c91-6dc8-41ee-92ef-2fa9d1e0b105 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/dbe34d9bb0994e7f80044be0a373ed5e/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:45.645918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd695c91-6dc8-41ee-92ef-2fa9d1e0b105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=dbe34d9bb0994e7f80044be0a373ed5e, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:45.649829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd695c91-6dc8-41ee-92ef-2fa9d1e0b105 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:45.669914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 321/649] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:45 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/dbe34d9bb0994e7f80044be0a373ed5e/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:46.853819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0d8e-24e0-45ce-9218-6df5cfbebf46 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:46.854365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0d8e-24e0-45ce-9218-6df5cfbebf46 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:46.854365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0d8e-24e0-45ce-9218-6df5cfbebf46 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:46.856484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 329/650] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:46.862139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1f39-53ac-4e4f-b081-66e51a18e107 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:46.862532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1f39-53ac-4e4f-b081-66e51a18e107 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:46.862762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1f39-53ac-4e4f-b081-66e51a18e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:46.882649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-49ef1f39-53ac-4e4f-b081-66e51a18e107 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:46.883908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-49ef1f39-53ac-4e4f-b081-66e51a18e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:46.962317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 322/651] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:46 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:46.998821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0d8e-24e0-45ce-9218-6df5cfbebf46 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.017423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0d8e-24e0-45ce-9218-6df5cfbebf46 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.022348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab96949-291a-4992-a26a-06b66ddf8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.023145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab96949-291a-4992-a26a-06b66ddf8a7d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.023428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab96949-291a-4992-a26a-06b66ddf8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.023724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab96949-291a-4992-a26a-06b66ddf8a7d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.041479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab96949-291a-4992-a26a-06b66ddf8a7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:47.048191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-3ab96949-291a-4992-a26a-06b66ddf8a7d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:47.054608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 330/652] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:47.055835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef1f39-53ac-4e4f-b081-66e51a18e107 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.064268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef1f39-53ac-4e4f-b081-66e51a18e107 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.072389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.073055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.073336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.073611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.074359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:47.074663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.076282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.090162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 323/653] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:47.096453 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab96949-291a-4992-a26a-06b66ddf8a7d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.106060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab96949-291a-4992-a26a-06b66ddf8a7d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.116247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.117030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.117362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.117642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.139082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.139082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.163793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:47.165672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 331/654] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:47.171683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.185284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac4017-b1fc-4f99-b56e-d5f6ed2dd32e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.195823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.196499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.196781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.197057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.197791 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:47.198098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.199700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.218441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 324/655] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:47.224296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.241299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb4ee4-bf22-4e93-a356-f70a36081a4b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.247671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.248747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.249320 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.249795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.261914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.264322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.281951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:25:47.283864 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 332/656] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:47.289972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.305432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e103df-cf04-4013-b6c2-2031bf9642eb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.315694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.316402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.316683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.316961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.317865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:47.318177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.320146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.350344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 325/657] 10.222.0.16 () {56 vars in 1157 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:47.356330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.369138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9f377-7427-4427-a4c1-53e58f89bcdd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.375961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e0bc0-9520-42cf-ba32-9582d645f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.376879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0bc0-9520-42cf-ba32-9582d645f9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.377358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0bc0-9520-42cf-ba32-9582d645f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.377823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0bc0-9520-42cf-ba32-9582d645f9f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.391309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0bc0-9520-42cf-ba32-9582d645f9f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.393357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0bc0-9520-42cf-ba32-9582d645f9f6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.409196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 333/658] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:47.415539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.429039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f9516-c529-4cf1-b6ad-b5f2966c7268 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.437662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.438463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.438736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.439008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.455425 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.457310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.477865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:47.479083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 326/659] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:47.485338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e0bc0-9520-42cf-ba32-9582d645f9f6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.494399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e0bc0-9520-42cf-ba32-9582d645f9f6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.503671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.504356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.504637 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.504910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.505630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:47.505932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.507606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.519783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 334/660] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:47.526198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.535613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1611e6e-580c-45ea-8b63-62fe94f83f78 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.543952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.544768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.545050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.545325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.557786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.559778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.577754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:47.579145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 327/661] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:47.585668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.595267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7950bf9-a96b-4e88-a0e9-32a830ec33cf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.604523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27b405-d762-455b-9eaf-26626442b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.605190 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27b405-d762-455b-9eaf-26626442b18b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.605476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27b405-d762-455b-9eaf-26626442b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.605751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27b405-d762-455b-9eaf-26626442b18b admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.606597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27b405-d762-455b-9eaf-26626442b18b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:47.606854 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27b405-d762-455b-9eaf-26626442b18b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.608736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27b405-d762-455b-9eaf-26626442b18b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.622340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 335/662] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:47.628577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:47.644598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675da85a-7f6a-405b-a095-74e43917e22f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:47.652331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2f5df-c171-4e39-9965-19fc363ed797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:47.652998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f5df-c171-4e39-9965-19fc363ed797 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.653281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f5df-c171-4e39-9965-19fc363ed797 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.653561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f5df-c171-4e39-9965-19fc363ed797 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.654392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2f5df-c171-4e39-9965-19fc363ed797 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=7195fd0ceaf6413d80120c47b3c86358) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:47.654705 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2f5df-c171-4e39-9965-19fc363ed797 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:47.656600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2f5df-c171-4e39-9965-19fc363ed797 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:47.663274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 328/663] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:47 2021] GET /identity/v3/role_assignments?user.id=7195fd0ceaf6413d80120c47b3c86358&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:47.921951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e93b-1cbb-4960-8aed-5daf67b12f70 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.922631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e93b-1cbb-4960-8aed-5daf67b12f70 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.922631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e93b-1cbb-4960-8aed-5daf67b12f70 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.924520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 336/664] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:47.946831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5918d9-8031-4eb9-b724-05fe7b0b32b2 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:47.947824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5918d9-8031-4eb9-b724-05fe7b0b32b2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:47.948332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5918d9-8031-4eb9-b724-05fe7b0b32b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:47.970388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9b5918d9-8031-4eb9-b724-05fe7b0b32b2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:47.971876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9b5918d9-8031-4eb9-b724-05fe7b0b32b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:47.982164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 329/665] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:47 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:48.009114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e93b-1cbb-4960-8aed-5daf67b12f70 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.026132 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e93b-1cbb-4960-8aed-5daf67b12f70 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.038050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89b994-0ec2-40fb-a199-0cb9a5e3841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.039322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b994-0ec2-40fb-a199-0cb9a5e3841e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.039836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b994-0ec2-40fb-a199-0cb9a5e3841e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.040316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b994-0ec2-40fb-a199-0cb9a5e3841e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.059943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89b994-0ec2-40fb-a199-0cb9a5e3841e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:48.067254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-7c89b994-0ec2-40fb-a199-0cb9a5e3841e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:48.069714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 337/666] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:48.076619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5918d9-8031-4eb9-b724-05fe7b0b32b2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.089167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5918d9-8031-4eb9-b724-05fe7b0b32b2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.100700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02614080-0368-4c4c-9107-d9fc73b32182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.101439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02614080-0368-4c4c-9107-d9fc73b32182 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.101722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02614080-0368-4c4c-9107-d9fc73b32182 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.101997 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02614080-0368-4c4c-9107-d9fc73b32182 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.102757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02614080-0368-4c4c-9107-d9fc73b32182 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.103058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02614080-0368-4c4c-9107-d9fc73b32182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.104771 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02614080-0368-4c4c-9107-d9fc73b32182 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.120109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 330/667] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.130322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89b994-0ec2-40fb-a199-0cb9a5e3841e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.143595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983a88-f7e9-46b2-bd7c-c2daa693e1dd None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.143962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983a88-f7e9-46b2-bd7c-c2daa693e1dd None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.144244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983a88-f7e9-46b2-bd7c-c2daa693e1dd None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.145528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89b994-0ec2-40fb-a199-0cb9a5e3841e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.151730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 331/668] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:48.152594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d49d40-e318-423d-be7b-0cfe9c96934d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.152887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d49d40-e318-423d-be7b-0cfe9c96934d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.153169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d49d40-e318-423d-be7b-0cfe9c96934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.158407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.160826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.161112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.161388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.180833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-94d49d40-e318-423d-be7b-0cfe9c96934d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:48.181862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.182581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-94d49d40-e318-423d-be7b-0cfe9c96934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:48.183765 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.197220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 332/669] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:48 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:48.202428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:48.207805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 338/670] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:48.210496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d49d40-e318-423d-be7b-0cfe9c96934d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.220097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d49d40-e318-423d-be7b-0cfe9c96934d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.224566 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.225476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.225846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.226138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.226871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.227175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.228945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.238449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.250256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a441c-c303-4598-b114-5ff22f0ad328 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.257839 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 333/671] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.264537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.264959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.265356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.265635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.266012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] PATH_INFO: `/v3/services/network` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.266676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.268305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.279663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:25:48.280687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b871-eb9c-4c9c-bea8-e569773da812 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.281357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 339/672] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:48.285344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd820ae-009e-40b0-a317-d09fa656e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.286153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd820ae-009e-40b0-a317-d09fa656e3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.286601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd820ae-009e-40b0-a317-d09fa656e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.288074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.289080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd820ae-009e-40b0-a317-d09fa656e3f5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.300832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6cb47-aaa1-421b-af71-d88f4afb6a27 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.306652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b356b2-8594-497a-8233-174682deb5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.307032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd820ae-009e-40b0-a317-d09fa656e3f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.307314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b356b2-8594-497a-8233-174682deb5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.307598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b356b2-8594-497a-8233-174682deb5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.307908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b356b2-8594-497a-8233-174682deb5f4 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.308620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b356b2-8594-497a-8233-174682deb5f4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.308927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b356b2-8594-497a-8233-174682deb5f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.309277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd820ae-009e-40b0-a317-d09fa656e3f5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.310516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b356b2-8594-497a-8233-174682deb5f4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.319827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 340/673] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:48.321164 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573cd7f-628d-4154-b8d0-087ad98f49c6 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.321446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573cd7f-628d-4154-b8d0-087ad98f49c6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.321721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573cd7f-628d-4154-b8d0-087ad98f49c6 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.325562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 341/674] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:48.326427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573cd7f-628d-4154-b8d0-087ad98f49c6 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.329877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-bfd820ae-009e-40b0-a317-d09fa656e3f5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:25:48.331085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 334/675] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:48.337762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001be6b9-f6d3-42c5-bb32-8687147712f0 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.338055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001be6b9-f6d3-42c5-bb32-8687147712f0 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.338388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001be6b9-f6d3-42c5-bb32-8687147712f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.349154 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573cd7f-628d-4154-b8d0-087ad98f49c6 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.354472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.355190 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.355491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.356318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.357034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] RBAC: Adding query filter params (type=network) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.357341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.359248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.362618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-001be6b9-f6d3-42c5-bb32-8687147712f0 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:48.364093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-001be6b9-f6d3-42c5-bb32-8687147712f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:48.367783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 342/676] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/services?type=network => generated 350 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.368768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.379215 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 335/677] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:48 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:48.380598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd735-faaa-46e1-a4ee-a64c137c6231 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.384473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001be6b9-f6d3-42c5-bb32-8687147712f0 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.393761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.394650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.395157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.395657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.396798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.397983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.400743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.403945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001be6b9-f6d3-42c5-bb32-8687147712f0 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.415345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.416035 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.416314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.416588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.418024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] RBAC: Adding query filter params (interface=public, service_id=bbaa6e12d86c4f6daa71a8722c1f10d5, region_id=RegionOne) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.418024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.418722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:48.418722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:48.418722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:48.419609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.427689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 336/678] 10.222.0.16 () {56 vars in 1273 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/endpoints?service_id=bbaa6e12d86c4f6daa71a8722c1f10d5&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.429187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.429550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 343/679] 10.222.0.16 () {56 vars in 1171 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.434769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.444670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09612dc1-60c7-4fb8-9612-506b2c500ec2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.445175 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8338943-66f7-4f3d-b192-894845c242cb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.449301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.450189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.450506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.450851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.451303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fbc68-250a-410e-b779-956b4b87c828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.451565 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.452405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fbc68-250a-410e-b779-956b4b87c828 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.452915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fbc68-250a-410e-b779-956b4b87c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.453428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.453559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fbc68-250a-410e-b779-956b4b87c828 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.454600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fbc68-250a-410e-b779-956b4b87c828 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.457358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fbc68-250a-410e-b779-956b4b87c828 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.463131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 344/680] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/services => generated 772 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.471822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:25:48.471822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 337/681] 10.222.0.16 () {56 vars in 1151 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:48.473229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fbc68-250a-410e-b779-956b4b87c828 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.473985 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.487770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe47e9-dfc6-458d-9b34-3096e9439b06 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.488349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fbc68-250a-410e-b779-956b4b87c828 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.495893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.496582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.497271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.497551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.498843 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.499599 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.500651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.501256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.501579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.501849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.503604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.518149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 338/682] 10.222.0.16 () {56 vars in 1146 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.519592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.526159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.529251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.530398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007765-270d-4d86-9bda-eaf6286636d8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.543769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.545608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.545899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.546432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.547176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.547482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.551368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.565873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:48.567450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 339/683] 10.222.0.16 () {56 vars in 1146 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.572312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 345/684] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:48.579962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.580146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.590772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb51c6-6de7-4429-a6c7-733a9987dd92 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.597285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.598236 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.598519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.598796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.601816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] RBAC: Adding query filter params (interface=public, service_id=a6c13ca8e75746f8aa062125ad20d168, region_id=RegionOne) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.602868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.603949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:48.603949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:48.603949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:48.604297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0314b1a-6610-48b1-ada6-ed20a5e9b549 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.606274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.612361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fffbf9-3e3f-4065-897d-cccd26c3bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.614720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fffbf9-3e3f-4065-897d-cccd26c3bdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.615001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fffbf9-3e3f-4065-897d-cccd26c3bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.615276 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fffbf9-3e3f-4065-897d-cccd26c3bdc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.617809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fffbf9-3e3f-4065-897d-cccd26c3bdc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.618125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fffbf9-3e3f-4065-897d-cccd26c3bdc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.623410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fffbf9-3e3f-4065-897d-cccd26c3bdc1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.625636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 346/685] 10.222.0.16 () {56 vars in 1273 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/endpoints?service_id=a6c13ca8e75746f8aa062125ad20d168&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.634640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.650887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5669e-a9c9-4743-b917-563903206247 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.653590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 340/686] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.655342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3769dd-f863-4fae-af8f-37d06ff753f9 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.655909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3769dd-f863-4fae-af8f-37d06ff753f9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.656402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3769dd-f863-4fae-af8f-37d06ff753f9 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.658440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 341/687] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:48.660311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3769dd-f863-4fae-af8f-37d06ff753f9 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.661279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44d470-cdcf-49b1-8cf7-9e1effcf077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.662062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d470-cdcf-49b1-8cf7-9e1effcf077c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.662947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d470-cdcf-49b1-8cf7-9e1effcf077c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.663229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d470-cdcf-49b1-8cf7-9e1effcf077c admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.664317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44d470-cdcf-49b1-8cf7-9e1effcf077c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.666062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44d470-cdcf-49b1-8cf7-9e1effcf077c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.672134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 347/688] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.676026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9595a-57de-4c64-b55d-92b535b143fd None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.676026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9595a-57de-4c64-b55d-92b535b143fd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.676026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9595a-57de-4c64-b55d-92b535b143fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.686243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3769dd-f863-4fae-af8f-37d06ff753f9 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.695612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-41e9595a-57de-4c64-b55d-92b535b143fd None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:48.698148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-41e9595a-57de-4c64-b55d-92b535b143fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:48.700164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.700983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.701266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.701538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.711668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.713963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.717512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 348/689] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:48 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:48.733430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:48.739787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 342/690] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:48.742693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9595a-57de-4c64-b55d-92b535b143fd None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.746134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.753969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9595a-57de-4c64-b55d-92b535b143fd None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.756287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a227-3f3c-4a1a-afc7-a31b39531e95 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.758502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.759276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.759561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.760861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.761803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.762135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.764462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.764913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9583-b453-4684-a168-4ddc6b79e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.766021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9583-b453-4684-a168-4ddc6b79e651 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.766538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9583-b453-4684-a168-4ddc6b79e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.767054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9583-b453-4684-a168-4ddc6b79e651 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.783845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 349/691] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:48.789244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e9583-b453-4684-a168-4ddc6b79e651 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:48.789402 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.797689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-189e9583-b453-4684-a168-4ddc6b79e651 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:48.799021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd824b15-eb30-42b7-b860-02e8ed78a7f3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.799569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 343/692] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:48.804285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5d97-b544-4ca0-8363-cb4bdc4a8f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.805217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5d97-b544-4ca0-8363-cb4bdc4a8f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.805480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5d97-b544-4ca0-8363-cb4bdc4a8f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.805753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5d97-b544-4ca0-8363-cb4bdc4a8f06 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/e17902fcace54636bd031101c4672759/roles/2b4c5582fd5d417996790d0ed9464d51` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.808009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9583-b453-4684-a168-4ddc6b79e651 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.820124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9583-b453-4684-a168-4ddc6b79e651 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.824361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a5d97-b544-4ca0-8363-cb4bdc4a8f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=e17902fcace54636bd031101c4672759, role_id=2b4c5582fd5d417996790d0ed9464d51)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.826918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.827375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a5d97-b544-4ca0-8363-cb4bdc4a8f06 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.828267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.828763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.829299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.830272 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.830878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.833113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.845159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 344/694] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:48.851257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 350/694] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:48 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/e17902fcace54636bd031101c4672759/roles/2b4c5582fd5d417996790d0ed9464d51 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:25:48.852563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.863679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63030ba-ce96-4ef7-9fd4-c0f519b70416 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.932222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.933088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.933372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.933749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.945998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.947989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:48.970749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:48.972546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 345/695] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:48.979452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5d97-b544-4ca0-8363-cb4bdc4a8f06 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:48.989961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5d97-b544-4ca0-8363-cb4bdc4a8f06 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:48.994827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:48.995567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:48.995881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:48.996322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:48.997066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:48.997425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:48.999189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.013624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 351/696] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:49.019645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:49.030133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e580-d57a-4471-9959-c45f223f832c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:49.034526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:49.035435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:49.035734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:49.036047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:49.044230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:49.046308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.061464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:25:49.063026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 346/697] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:25:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:49.069686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:49.079357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28127-1b31-4998-be11-e98519f753ab admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:49.083828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:49.084615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:49.084898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:49.085179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:49.086076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:49.086381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:49.088744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.108766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 352/698] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:25:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:49.117772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:49.130159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43d9c-c277-4ac1-861e-23e53f0d6f09 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:49.134399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891163-5533-40b9-8afe-ffc38c2cd8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:49.135241 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891163-5533-40b9-8afe-ffc38c2cd8be admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:49.135651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891163-5533-40b9-8afe-ffc38c2cd8be admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:49.136075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891163-5533-40b9-8afe-ffc38c2cd8be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:49.149225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85891163-5533-40b9-8afe-ffc38c2cd8be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:49.151182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85891163-5533-40b9-8afe-ffc38c2cd8be admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.160358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 347/699] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:49 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:49.172015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:49.182775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b98d7-43c6-4c27-aaf8-64a60b5bb58d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:49.191077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:49.192104 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:49.192551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:49.192968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:49.208074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:49.211048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.233832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:49.235357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 353/700] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:49.242591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891163-5533-40b9-8afe-ffc38c2cd8be admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:49.251068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891163-5533-40b9-8afe-ffc38c2cd8be admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:49.262101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:49.262934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:49.263381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:49.263666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:49.264415 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:49.264773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:49.266444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.285083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 348/701] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:49.291496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:49.304973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434a67e-1e24-430f-b871-e881f5892142 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:49.315075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:49.316165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:49.316670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:49.317163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:49.325286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:49.327483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.344613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:49.346024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 354/702] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:49.352327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:49.366101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b87e1-01d4-4c62-af0f-0ea5d7ad4b37 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:49.375592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e27a8-fd09-4fe8-b235-dae047e50f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:49.376286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e27a8-fd09-4fe8-b235-dae047e50f19 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:49.376576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e27a8-fd09-4fe8-b235-dae047e50f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:49.376852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e27a8-fd09-4fe8-b235-dae047e50f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:49.377642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e27a8-fd09-4fe8-b235-dae047e50f19 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:49.377950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e27a8-fd09-4fe8-b235-dae047e50f19 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:49.379810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e27a8-fd09-4fe8-b235-dae047e50f19 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.397364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 349/703] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:49.403873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:49.416824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326a80-b73d-4d09-b254-c26a8de19179 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:49.427286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aca183-6a4d-4d65-a0fd-41519e67d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:49.429300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca183-6a4d-4d65-a0fd-41519e67d4fe admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:49.429845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca183-6a4d-4d65-a0fd-41519e67d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:49.430325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca183-6a4d-4d65-a0fd-41519e67d4fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:49.431405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aca183-6a4d-4d65-a0fd-41519e67d4fe admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=dbe34d9bb0994e7f80044be0a373ed5e) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:49.431941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aca183-6a4d-4d65-a0fd-41519e67d4fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:49.434088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aca183-6a4d-4d65-a0fd-41519e67d4fe admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:49.445743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 355/704] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:49 2021] GET /identity/v3/role_assignments?user.id=dbe34d9bb0994e7f80044be0a373ed5e&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:50.229909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88d5b-3c8c-4310-ad2d-c7f7b3fce4fd None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.230417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88d5b-3c8c-4310-ad2d-c7f7b3fce4fd None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.230490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88d5b-3c8c-4310-ad2d-c7f7b3fce4fd None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.232639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 350/705] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:50.238823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447905b-834b-4c8c-984a-e20374b5fd32 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.239232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447905b-834b-4c8c-984a-e20374b5fd32 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.239436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447905b-834b-4c8c-984a-e20374b5fd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.262143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9447905b-834b-4c8c-984a-e20374b5fd32 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:50.263296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9447905b-834b-4c8c-984a-e20374b5fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:50.275303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 356/706] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:50 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:50.307025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88d5b-3c8c-4310-ad2d-c7f7b3fce4fd None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.325295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88d5b-3c8c-4310-ad2d-c7f7b3fce4fd None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.329581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6988314-49b0-4cb3-81cf-15ad4bdb50e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.330363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6988314-49b0-4cb3-81cf-15ad4bdb50e9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.330645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6988314-49b0-4cb3-81cf-15ad4bdb50e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.331008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6988314-49b0-4cb3-81cf-15ad4bdb50e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.348634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6988314-49b0-4cb3-81cf-15ad4bdb50e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:50.355513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-a6988314-49b0-4cb3-81cf-15ad4bdb50e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:50.357106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 351/707] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:50.363766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447905b-834b-4c8c-984a-e20374b5fd32 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.377037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447905b-834b-4c8c-984a-e20374b5fd32 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.384865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.385547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.385828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.386104 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.386859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:50.387167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.388810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.400422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 357/708] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:50.406623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6988314-49b0-4cb3-81cf-15ad4bdb50e9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.416061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6988314-49b0-4cb3-81cf-15ad4bdb50e9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.420429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.421222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.421506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.421783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.433375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.435221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.451827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:50.453322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 352/709] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:50.460398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.471812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135dc1a-8ad2-477d-8b5b-64d420ccfb30 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.476895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.477556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.477854 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.478167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.478894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:50.479244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.480933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.498958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 358/710] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:50.505289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.515172 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726173b-85f7-4207-9303-d3b20ebfa90a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.524297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.525105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.525389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.525665 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.534144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.536226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.550162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:25:50.551633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 353/711] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:50.558631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.567829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5000cf-f86b-4807-8384-e1edc27cdd3a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.572608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.573275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.573604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.573880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.574770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:50.575086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.577104 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.604506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 359/712] 10.222.0.16 () {56 vars in 1157 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:50.610619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.620592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a816-f275-4438-8ce3-0c24b74994c7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.625103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.625891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.626228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.626509 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.637966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.639776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.656490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:50.658030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 354/713] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:50.664908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.674316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0a0b0-c3cd-458a-860f-a843731f80e3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.678904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.679615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.679930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.680223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.680984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:50.681289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.682995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.695260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 360/714] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:50.701418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.711013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043243c5-cec5-4984-bbf3-1f2639f9166c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.715777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.716570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.716902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.717178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.724492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.727097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.741073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:50.742436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 355/715] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:50.748817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.759316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04b0f-d33f-43b8-8970-9aff9227848d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.763830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eb70f-861c-4620-b587-0a2810b2d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.764488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb70f-861c-4620-b587-0a2810b2d386 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.764826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb70f-861c-4620-b587-0a2810b2d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.765102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb70f-861c-4620-b587-0a2810b2d386 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.765994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eb70f-861c-4620-b587-0a2810b2d386 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:50.766305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eb70f-861c-4620-b587-0a2810b2d386 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.768246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eb70f-861c-4620-b587-0a2810b2d386 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.781281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 361/716] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:50.788495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:50.797617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5c267-0d95-4554-bda0-924a94565731 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:50.806081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cea723-5635-43e0-955b-9413cc03ab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:50.806960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cea723-5635-43e0-955b-9413cc03ab5b admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:50.807244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cea723-5635-43e0-955b-9413cc03ab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:50.807520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cea723-5635-43e0-955b-9413cc03ab5b admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/7195fd0ceaf6413d80120c47b3c86358/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:50.812967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cea723-5635-43e0-955b-9413cc03ab5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=7195fd0ceaf6413d80120c47b3c86358, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:50.815614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cea723-5635-43e0-955b-9413cc03ab5b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:50.841942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 356/717] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:50 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/7195fd0ceaf6413d80120c47b3c86358/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:51.315292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5b50-05a3-49cc-9c71-0d06ae84ca0b None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.316017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5b50-05a3-49cc-9c71-0d06ae84ca0b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.316017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5b50-05a3-49cc-9c71-0d06ae84ca0b None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.317907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 362/718] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:51.324823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077bd82-7245-4aa7-8808-64348f0ad0c7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.325365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077bd82-7245-4aa7-8808-64348f0ad0c7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.325365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077bd82-7245-4aa7-8808-64348f0ad0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.348574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1077bd82-7245-4aa7-8808-64348f0ad0c7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:51.350325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1077bd82-7245-4aa7-8808-64348f0ad0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:51.422271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 357/719] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:51 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:51.425382 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03079b3-7662-417a-8f32-85847aec2943 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.425673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03079b3-7662-417a-8f32-85847aec2943 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.425954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03079b3-7662-417a-8f32-85847aec2943 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.427720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 363/720] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:51.447068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888143-72b5-4dd4-a2ad-d4c25153c67c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.447068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888143-72b5-4dd4-a2ad-d4c25153c67c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.447068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40888143-72b5-4dd4-a2ad-d4c25153c67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.453488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03079b3-7662-417a-8f32-85847aec2943 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.459199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03079b3-7662-417a-8f32-85847aec2943 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.471110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.472212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.472726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.473194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] PATH_INFO: `/v3/services/network` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.474056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.476666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-40888143-72b5-4dd4-a2ad-d4c25153c67c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:51.477123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.477839 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-40888143-72b5-4dd4-a2ad-d4c25153c67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:51.489413 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:25:51.489710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 358/721] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:51 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:51.492014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 364/722] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:51.497996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40888143-72b5-4dd4-a2ad-d4c25153c67c None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.507869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40888143-72b5-4dd4-a2ad-d4c25153c67c None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.519805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.520509 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.520793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.521070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.521932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] RBAC: Adding query filter params (name=network) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:51.522480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.522971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.523983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.529530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 359/723] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:51.535269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.540025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc681e-5128-467a-9cdc-d95a4a20b72e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.546004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecea3e-7743-4fd1-b8b9-fb7653909dce admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.549403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.550330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.550629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.550873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.551590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.551821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.552686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.553217 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.553608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.553857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.554759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:51.555252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.557097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.563391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 360/724] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/services?type=network => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:51.578199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.579076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:25:51.580689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 365/725] 10.222.0.16 () {56 vars in 1151 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:51.587843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.589775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a052-e338-4ccc-a933-08a206d478f5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.596606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a8ab8-368b-4980-9158-e28e4b1a82ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.597488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8ab8-368b-4980-9158-e28e4b1a82ac admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.597950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8ab8-368b-4980-9158-e28e4b1a82ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.599964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305dc17-35e1-4078-992d-166d2dc8a467 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.600452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8ab8-368b-4980-9158-e28e4b1a82ac admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.601386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a8ab8-368b-4980-9158-e28e4b1a82ac admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.603720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-b47a8ab8-368b-4980-9158-e28e4b1a82ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:51.603720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:25:51.603720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:25:51.605489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a8ab8-368b-4980-9158-e28e4b1a82ac admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.615029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed21c8-c7e2-4b29-933d-b25096065ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.616487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed21c8-c7e2-4b29-933d-b25096065ffe admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.616980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed21c8-c7e2-4b29-933d-b25096065ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.617438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed21c8-c7e2-4b29-933d-b25096065ffe admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.618330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed21c8-c7e2-4b29-933d-b25096065ffe admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:51.619270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed21c8-c7e2-4b29-933d-b25096065ffe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.622516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed21c8-c7e2-4b29-933d-b25096065ffe admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.629509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 366/726] 10.222.0.16 () {56 vars in 1146 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:51.631687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a745-6392-4b44-8c7d-e9d2e505e21a None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.632506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a745-6392-4b44-8c7d-e9d2e505e21a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.632856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a745-6392-4b44-8c7d-e9d2e505e21a None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.635042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 367/727] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:51.640148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15a745-6392-4b44-8c7d-e9d2e505e21a None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.642920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 361/728] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:25:51 2021] POST /identity/v3/endpoints => generated 327 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:25:51.644565 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01222-7b06-4a43-9b17-94ee199ba974 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.645070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01222-7b06-4a43-9b17-94ee199ba974 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.645582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01222-7b06-4a43-9b17-94ee199ba974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.687692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15a745-6392-4b44-8c7d-e9d2e505e21a None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.689787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6ad01222-7b06-4a43-9b17-94ee199ba974 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:51.694042 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6ad01222-7b06-4a43-9b17-94ee199ba974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:51.697709 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.700089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.700595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.701390 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.702981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:51.705277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.707609 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.710640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 362/729] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:51 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:51.717286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 368/730] 10.222.0.16 () {56 vars in 1146 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:51.723336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad01222-7b06-4a43-9b17-94ee199ba974 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.746163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad01222-7b06-4a43-9b17-94ee199ba974 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.750822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.761650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08085c4f-619b-4485-a191-ab7ba924aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.763998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68b526-1173-4770-ae0c-0e5ede1b8f6a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.764709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08085c4f-619b-4485-a191-ab7ba924aeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.765066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08085c4f-619b-4485-a191-ab7ba924aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.765405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08085c4f-619b-4485-a191-ab7ba924aeb2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.766710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08085c4f-619b-4485-a191-ab7ba924aeb2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.768847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08085c4f-619b-4485-a191-ab7ba924aeb2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.775523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d924bcd-5996-4a96-97b8-7f035b8a65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.776452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924bcd-5996-4a96-97b8-7f035b8a65ce admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.778175 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924bcd-5996-4a96-97b8-7f035b8a65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.778481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924bcd-5996-4a96-97b8-7f035b8a65ce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.795454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d924bcd-5996-4a96-97b8-7f035b8a65ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:51.802717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-3d924bcd-5996-4a96-97b8-7f035b8a65ce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:25:51.811153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 363/731] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:25:51 2021] POST /identity/v3/endpoints => generated 346 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:51.815928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 369/732] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:51.820266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08085c4f-619b-4485-a191-ab7ba924aeb2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.840078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08085c4f-619b-4485-a191-ab7ba924aeb2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.844354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.845043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.845322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.845594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.846350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:51.846650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.848294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.863204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 364/733] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:51.864689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d924bcd-5996-4a96-97b8-7f035b8a65ce admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.880226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d924bcd-5996-4a96-97b8-7f035b8a65ce admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.888984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.889799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.890083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.890359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.908054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.910000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.930911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:51.932588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 370/734] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:51.939164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.949338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd35f-0aee-4fd4-ba01-5d2de626950d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.953884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.954625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.954905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.955178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:51.956029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:51.956333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:51.958032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:51.971922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 365/735] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:51.979814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:51.989722 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428e09-724b-4990-b9c9-c3dfe5c092e4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:51.995593 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:51.996462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:51.996798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:51.997076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.005593 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.008517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.024134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:25:52.025380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 371/736] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:25:51 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:52.032528 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.042878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5b24d-cf12-4e56-af5e-b6d542c32ddf admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.052301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.053555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.053843 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.054226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.055075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:52.055386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.057352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.075975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 366/737] 10.222.0.16 () {56 vars in 1171 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:52.086289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.096462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9fa31-85e8-4abb-9c05-f2063e7602df admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.103106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf2e2-f502-4736-b9fa-f351e4f50111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.103806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf2e2-f502-4736-b9fa-f351e4f50111 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.104153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf2e2-f502-4736-b9fa-f351e4f50111 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.104430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf2e2-f502-4736-b9fa-f351e4f50111 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.112832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf2e2-f502-4736-b9fa-f351e4f50111 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.114600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf2e2-f502-4736-b9fa-f351e4f50111 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.129352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 372/738] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:52.136012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.145230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db66640-2ad4-40ea-bea5-b4c0da7cf808 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.149742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.150639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.150927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.151197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.161868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.169489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.187854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:52.189080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 367/739] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:52.195761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf2e2-f502-4736-b9fa-f351e4f50111 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.204373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf2e2-f502-4736-b9fa-f351e4f50111 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.208806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.209524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.209809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.210081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.210807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:52.211112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.212739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.225591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 373/740] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:52.231642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.241806 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b8a9-9501-4fe4-a691-7ca7143f72df admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.246274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.247163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.247462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.247759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.255558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.257749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.271152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:52.272761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 368/741] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:52.279058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.289043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9fa34-cf56-4104-8a09-0d96e4f8d964 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.293433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2112-b087-477f-b50f-01efe53dca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.294143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2112-b087-477f-b50f-01efe53dca94 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.294431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2112-b087-477f-b50f-01efe53dca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.294705 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2112-b087-477f-b50f-01efe53dca94 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.295662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2112-b087-477f-b50f-01efe53dca94 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:52.296002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2112-b087-477f-b50f-01efe53dca94 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.297984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2112-b087-477f-b50f-01efe53dca94 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.311405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 374/742] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:52.317966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.331450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f18f5-c3dc-4f86-8136-8bb3e606d556 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.336407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ec820-6877-478b-b072-dd13cb77c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.336938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec820-6877-478b-b072-dd13cb77c5bb admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.337273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec820-6877-478b-b072-dd13cb77c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.337545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec820-6877-478b-b072-dd13cb77c5bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.338421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ec820-6877-478b-b072-dd13cb77c5bb admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=e17902fcace54636bd031101c4672759) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:52.338981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ec820-6877-478b-b072-dd13cb77c5bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.340902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ec820-6877-478b-b072-dd13cb77c5bb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.347323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 369/743] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/role_assignments?user.id=e17902fcace54636bd031101c4672759&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:52.623461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379bc5a-a2c2-4df1-88f1-61aaf856a56b None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.624126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379bc5a-a2c2-4df1-88f1-61aaf856a56b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.624126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379bc5a-a2c2-4df1-88f1-61aaf856a56b None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.626135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 375/744] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:52.632156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8590b-ccb3-4701-a067-3ea7f4f72c3e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.632444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8590b-ccb3-4701-a067-3ea7f4f72c3e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.632722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8590b-ccb3-4701-a067-3ea7f4f72c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.650593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3aa8590b-ccb3-4701-a067-3ea7f4f72c3e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:52.652122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3aa8590b-ccb3-4701-a067-3ea7f4f72c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:52.659773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 370/745] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:52 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:52.683350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379bc5a-a2c2-4df1-88f1-61aaf856a56b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.694871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379bc5a-a2c2-4df1-88f1-61aaf856a56b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.699066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.699926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.700202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.700473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.701121 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.702711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.714689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:25:52.716148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 376/746] 10.222.0.16 () {56 vars in 1154 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:52.722575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8590b-ccb3-4701-a067-3ea7f4f72c3e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.731424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8590b-ccb3-4701-a067-3ea7f4f72c3e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.735692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d823e-7164-450f-8262-895f1df94bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.736366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d823e-7164-450f-8262-895f1df94bce admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.736643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d823e-7164-450f-8262-895f1df94bce admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.736914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d823e-7164-450f-8262-895f1df94bce admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.737613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d823e-7164-450f-8262-895f1df94bce admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:52.737911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d823e-7164-450f-8262-895f1df94bce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.739517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d823e-7164-450f-8262-895f1df94bce admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.744946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 371/747] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:52.751038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:52.760742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ae70-618c-4e1f-a58d-d5e13718e49c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:52.765130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00e31d-07dc-429c-8fd9-165ec41be5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:52.765788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e31d-07dc-429c-8fd9-165ec41be5fd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:52.766115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e31d-07dc-429c-8fd9-165ec41be5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:52.766395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e31d-07dc-429c-8fd9-165ec41be5fd admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:52.767136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e31d-07dc-429c-8fd9-165ec41be5fd admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:52.767439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e31d-07dc-429c-8fd9-165ec41be5fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:52.769105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e31d-07dc-429c-8fd9-165ec41be5fd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:52.774499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 377/748] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:25:52 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:53.401689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185d9eb-eb19-435d-b523-5b89546f5db8 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.402659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185d9eb-eb19-435d-b523-5b89546f5db8 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.403160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185d9eb-eb19-435d-b523-5b89546f5db8 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.405413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 372/749] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:53.411668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870753c-ca31-4bae-8d46-e6beab8470e3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.412480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870753c-ca31-4bae-8d46-e6beab8470e3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.412964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870753c-ca31-4bae-8d46-e6beab8470e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.431396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c870753c-ca31-4bae-8d46-e6beab8470e3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:53.432910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c870753c-ca31-4bae-8d46-e6beab8470e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:53.440617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 378/750] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:53 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:53.466198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185d9eb-eb19-435d-b523-5b89546f5db8 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.478429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185d9eb-eb19-435d-b523-5b89546f5db8 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.482858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fe775-08c2-4ca4-82f0-c8ccd756fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.483921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fe775-08c2-4ca4-82f0-c8ccd756fa89 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.484402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fe775-08c2-4ca4-82f0-c8ccd756fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.484891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fe775-08c2-4ca4-82f0-c8ccd756fa89 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.496502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fe775-08c2-4ca4-82f0-c8ccd756fa89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:53.503546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-089fe775-08c2-4ca4-82f0-c8ccd756fa89 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:25:53.505280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 373/751] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:53.512705 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870753c-ca31-4bae-8d46-e6beab8470e3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.521478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870753c-ca31-4bae-8d46-e6beab8470e3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.526253 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.527183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.527663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.528161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.529100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:53.529653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.531484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.541375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 379/752] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:53.547959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fe775-08c2-4ca4-82f0-c8ccd756fa89 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.558652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fe775-08c2-4ca4-82f0-c8ccd756fa89 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.563175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.564247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.564730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.565199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.575877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.577979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.595137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:53.596633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 374/753] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:53.603642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.613258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad4407-c37e-42ba-9efa-e583ea2d0b60 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.618396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.619358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.619891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.620366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.621303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:53.621810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.623742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.637965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 380/754] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:53.644412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.654216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7013-3511-46c3-9fa5-0920e6f0cd03 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.658703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.659757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.660252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.660725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.669099 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.671363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.686252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:25:53.692048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 375/755] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:53.695174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.704799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d11c0-b66a-44df-bd55-6e86db5bb312 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.709468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.710378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.710867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.711351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.712419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:53.712977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.715285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.734047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 381/756] 10.222.0.16 () {56 vars in 1157 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:53.741281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.751038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3e54-f8d5-439a-8dea-f419cbc75eb0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.755623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3613d-131b-473f-956f-888f017f315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.757120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3613d-131b-473f-956f-888f017f315a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.757601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3613d-131b-473f-956f-888f017f315a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.758124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3613d-131b-473f-956f-888f017f315a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.766391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3613d-131b-473f-956f-888f017f315a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.768463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3613d-131b-473f-956f-888f017f315a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.778059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 376/757] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:25:53.784630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.794740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88131fc6-85f5-41cf-9667-d271f9b313d5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.799439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.800559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.801040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.801570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.812707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.814805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.832869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:53.835665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 382/758] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:53.842404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3613d-131b-473f-956f-888f017f315a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.852067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3613d-131b-473f-956f-888f017f315a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.856646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.857538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.858034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.858504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.859412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:53.859986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.861815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.874156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 377/759] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:53.880535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.890158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435b729-ea82-4453-bd47-f684e832b6e1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.894910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.896084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.897145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.898151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.905929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.908296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.922462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:53.924257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 383/760] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:53.931464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.945447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b21bb-ba75-4921-b19d-275bec30e446 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.950342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258531d-2c6f-4f4b-ad5f-9baaab00673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.951289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258531d-2c6f-4f4b-ad5f-9baaab00673e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.951804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258531d-2c6f-4f4b-ad5f-9baaab00673e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.952328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258531d-2c6f-4f4b-ad5f-9baaab00673e admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.953325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258531d-2c6f-4f4b-ad5f-9baaab00673e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:53.953828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258531d-2c6f-4f4b-ad5f-9baaab00673e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:53.955984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258531d-2c6f-4f4b-ad5f-9baaab00673e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:53.971387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 378/761] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:53.978916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:53.990581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea802-385c-4bd3-99c4-c21e20637ca3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:53.995331 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e92cc-5dd2-45a8-91c2-cb7018d66a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:53.996332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e92cc-5dd2-45a8-91c2-cb7018d66a4a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:53.996815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e92cc-5dd2-45a8-91c2-cb7018d66a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:53.997334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e92cc-5dd2-45a8-91c2-cb7018d66a4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:53.998355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e92cc-5dd2-45a8-91c2-cb7018d66a4a admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=7195fd0ceaf6413d80120c47b3c86358) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:53.998890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e92cc-5dd2-45a8-91c2-cb7018d66a4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.001061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e92cc-5dd2-45a8-91c2-cb7018d66a4a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.007754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 384/762] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:53 2021] GET /identity/v3/role_assignments?user.id=7195fd0ceaf6413d80120c47b3c86358&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:54.194135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b55f34-a8eb-4668-b7ff-9bd2f2ce7b04 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.194729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b55f34-a8eb-4668-b7ff-9bd2f2ce7b04 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.195219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b55f34-a8eb-4668-b7ff-9bd2f2ce7b04 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.197230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 379/763] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:54.203602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d73f-b3d7-41ea-a42b-d37380da4938 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.203862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d73f-b3d7-41ea-a42b-d37380da4938 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.204129 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d73f-b3d7-41ea-a42b-d37380da4938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.221919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8c22d73f-b3d7-41ea-a42b-d37380da4938 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:54.223388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8c22d73f-b3d7-41ea-a42b-d37380da4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:54.230939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 385/764] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:54 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:54.254937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b55f34-a8eb-4668-b7ff-9bd2f2ce7b04 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.267261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b55f34-a8eb-4668-b7ff-9bd2f2ce7b04 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.271413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.272251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.272526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.272796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.273437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.275072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.285985 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:25:54.287995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 380/765] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:54.294579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22d73f-b3d7-41ea-a42b-d37380da4938 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.303780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22d73f-b3d7-41ea-a42b-d37380da4938 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.308117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3ed2d-e883-4c56-ab18-5e8a40b385a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.308820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3ed2d-e883-4c56-ab18-5e8a40b385a6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.309099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3ed2d-e883-4c56-ab18-5e8a40b385a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.309372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3ed2d-e883-4c56-ab18-5e8a40b385a6 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.310074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3ed2d-e883-4c56-ab18-5e8a40b385a6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:54.310377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3ed2d-e883-4c56-ab18-5e8a40b385a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.311993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3ed2d-e883-4c56-ab18-5e8a40b385a6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.317079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 386/766] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:54.323723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.333218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fbc97-df45-455a-bc5a-6361ef5359c9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.337987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bead-e463-4658-8613-5f0323db7003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.338944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bead-e463-4658-8613-5f0323db7003 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.339222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bead-e463-4658-8613-5f0323db7003 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.339491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bead-e463-4658-8613-5f0323db7003 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.340317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223bead-e463-4658-8613-5f0323db7003 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:54.340615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223bead-e463-4658-8613-5f0323db7003 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.342351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223bead-e463-4658-8613-5f0323db7003 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.347439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 381/767] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:54.671530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdf3d6-8efb-4c5b-b661-7a356f36ac5f None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.672252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdf3d6-8efb-4c5b-b661-7a356f36ac5f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.672252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdf3d6-8efb-4c5b-b661-7a356f36ac5f None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.674141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 387/768] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:54.680489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7897e4-1caa-43b8-ae1c-fcfe0ac3f112 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.680988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7897e4-1caa-43b8-ae1c-fcfe0ac3f112 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.681140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7897e4-1caa-43b8-ae1c-fcfe0ac3f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.699538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-4f7897e4-1caa-43b8-ae1c-fcfe0ac3f112 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:54.700749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4f7897e4-1caa-43b8-ae1c-fcfe0ac3f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:54.708363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 382/769] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:54 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:54.734478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdf3d6-8efb-4c5b-b661-7a356f36ac5f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.746319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdf3d6-8efb-4c5b-b661-7a356f36ac5f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.750736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8d35d-5a15-444e-90cd-f532a4c7bf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.751532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8d35d-5a15-444e-90cd-f532a4c7bf3e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.751842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8d35d-5a15-444e-90cd-f532a4c7bf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.752116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8d35d-5a15-444e-90cd-f532a4c7bf3e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.762682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8d35d-5a15-444e-90cd-f532a4c7bf3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:54.769942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-d5a8d35d-5a15-444e-90cd-f532a4c7bf3e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:25:54.771438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 388/770] 10.222.0.16 () {56 vars in 1142 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:54.778420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7897e4-1caa-43b8-ae1c-fcfe0ac3f112 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.787110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7897e4-1caa-43b8-ae1c-fcfe0ac3f112 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.792340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.793267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.793749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.794220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.795159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:54.795672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.797493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.806659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 383/771] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:54.812620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8d35d-5a15-444e-90cd-f532a4c7bf3e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.822677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8d35d-5a15-444e-90cd-f532a4c7bf3e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.827479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.828286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.828613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.828890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.840421 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.842315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.858978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:54.860495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 389/772] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:54.867230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.876666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf6c08-8f22-481f-8eb2-d9a9c6e13eb3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.881335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.882063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.882345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.882620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.883394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:54.883701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.885431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.898764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 384/773] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:54.905799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.915871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0441-c396-4387-9241-85cfdb0c513e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.920407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6a0a9-51e7-4d95-ad5d-f45800b46a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.921275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a0a9-51e7-4d95-ad5d-f45800b46a00 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.921523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a0a9-51e7-4d95-ad5d-f45800b46a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.921851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a0a9-51e7-4d95-ad5d-f45800b46a00 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.931899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6a0a9-51e7-4d95-ad5d-f45800b46a00 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.934054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6a0a9-51e7-4d95-ad5d-f45800b46a00 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.950163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-12a6a0a9-51e7-4d95-ad5d-f45800b46a00 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:25:54.951761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 390/774] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:54.958029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:54.968526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd117f1-1534-472a-b2aa-7380b23d920d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:54.973122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:54.974048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.974531 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.975055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.976160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:54.976670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:54.978727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:54.988833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239251-ffee-4f23-82a3-f6671d620569 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:54.989131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239251-ffee-4f23-82a3-f6671d620569 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:54.989409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239251-ffee-4f23-82a3-f6671d620569 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:54.992120 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 391/775] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:54.998615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdb56-f1a5-46a0-8e5c-32e1ba834e10 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:55.003771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdb56-f1a5-46a0-8e5c-32e1ba834e10 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:55.003771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdb56-f1a5-46a0-8e5c-32e1ba834e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:55.004134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 385/776] 10.222.0.16 () {56 vars in 1171 bytes} [Wed Jul 28 03:25:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:55.005813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:55.017305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658c4d-3922-470e-8293-cf47a29f16f0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:55.019160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-781fdb56-f1a5-46a0-8e5c-32e1ba834e10 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:55.020712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-781fdb56-f1a5-46a0-8e5c-32e1ba834e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:55.022490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05a7e-24eb-4e3f-90da-3f30106940a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:55.023537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05a7e-24eb-4e3f-90da-3f30106940a4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:55.024108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05a7e-24eb-4e3f-90da-3f30106940a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:55.024585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05a7e-24eb-4e3f-90da-3f30106940a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:55.035825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 392/777] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:54 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:55.040772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c05a7e-24eb-4e3f-90da-3f30106940a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:55.042875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c05a7e-24eb-4e3f-90da-3f30106940a4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:55.054899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 386/778] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:25:55 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:25:55.056193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fdb56-f1a5-46a0-8e5c-32e1ba834e10 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:55.059598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05a7e-24eb-4e3f-90da-3f30106940a4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:55.065521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fdb56-f1a5-46a0-8e5c-32e1ba834e10 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:55.068217 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05a7e-24eb-4e3f-90da-3f30106940a4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:55.070594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:55.071511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:55.072027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:55.072500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:55.072905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:55.073686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:55.073901 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:55.074019 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:55.074227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:55.075418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:25:55.075418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:25:55.075418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:25:55.076712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:55.084995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:55.087357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:55.094728 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 393/779] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:25:55 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:55.108871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:55.110986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 387/780] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:55.117895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:55.141575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d35e8-5c89-4d62-931f-83682aacdc03 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:55.146775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:55.147982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:55.148497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:55.148974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:55.150013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:55.150523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:55.152581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:55.167978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 394/781] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:55.173850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:55.184827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734d278-8b41-4901-9b66-cf6e0571bba8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:55.189603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:55.190603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:55.190986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:55.191413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:55.199896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:55.202095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:55.217293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:55.219127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 388/782] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:55.226134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:55.235846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68784be6-3e55-44b7-a424-5232fdd5196f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:55.241460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e53db6-688d-4211-b9d7-5f71f32fed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:55.242427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53db6-688d-4211-b9d7-5f71f32fed8d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:55.242847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53db6-688d-4211-b9d7-5f71f32fed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:55.243328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53db6-688d-4211-b9d7-5f71f32fed8d admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:55.244310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53db6-688d-4211-b9d7-5f71f32fed8d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:55.244785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53db6-688d-4211-b9d7-5f71f32fed8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:55.246845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53db6-688d-4211-b9d7-5f71f32fed8d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:55.260458 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 395/783] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:55.267314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:55.278455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3384b92-4659-4bb1-8df2-46db10d91808 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:55.283047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f75a4-b329-4bb9-b982-e69d1c53f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:55.283767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f75a4-b329-4bb9-b982-e69d1c53f6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:55.284054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f75a4-b329-4bb9-b982-e69d1c53f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:55.284331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f75a4-b329-4bb9-b982-e69d1c53f6f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:55.285202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f75a4-b329-4bb9-b982-e69d1c53f6f8 admin admin] RBAC: Adding query filter params (role.id=03ae1df3911a446f8243e54b57bfb293, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=e17902fcace54636bd031101c4672759) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:55.285500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f75a4-b329-4bb9-b982-e69d1c53f6f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:55.288112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f75a4-b329-4bb9-b982-e69d1c53f6f8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:55.294439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 389/784] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:25:55 2021] GET /identity/v3/role_assignments?user.id=e17902fcace54636bd031101c4672759&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=03ae1df3911a446f8243e54b57bfb293 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:56.298676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b4d75-fb3d-401c-ac5d-e8ea7364a7e2 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:56.299185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b4d75-fb3d-401c-ac5d-e8ea7364a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:56.299296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b4d75-fb3d-401c-ac5d-e8ea7364a7e2 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:56.301015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 396/785] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:56.307909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4440da-5abb-43a7-911c-eb5990b60ae4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:56.308350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4440da-5abb-43a7-911c-eb5990b60ae4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:56.308534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4440da-5abb-43a7-911c-eb5990b60ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:56.327190 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0f4440da-5abb-43a7-911c-eb5990b60ae4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:56.328882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0f4440da-5abb-43a7-911c-eb5990b60ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:56.337017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 390/786] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:56 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:56.360444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b4d75-fb3d-401c-ac5d-e8ea7364a7e2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:56.372839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b4d75-fb3d-401c-ac5d-e8ea7364a7e2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:56.377399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:56.378427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:56.378935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:56.379422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:56.380334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:56.382883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:56.394330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:25:56.396020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 397/787] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:25:56 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:56.403072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4440da-5abb-43a7-911c-eb5990b60ae4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:56.411924 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4440da-5abb-43a7-911c-eb5990b60ae4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:56.416700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6751-afd0-4396-9d96-34cd87f0b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:56.417606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6751-afd0-4396-9d96-34cd87f0b160 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:56.418109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6751-afd0-4396-9d96-34cd87f0b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:56.418581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6751-afd0-4396-9d96-34cd87f0b160 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:56.419490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6751-afd0-4396-9d96-34cd87f0b160 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:56.420051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6751-afd0-4396-9d96-34cd87f0b160 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:56.421847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6751-afd0-4396-9d96-34cd87f0b160 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:56.427091 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 391/788] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:25:56 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:56.434249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:56.444145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd19f2-ec01-487e-b885-2b708f21a20a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:56.448843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634f2d9-7267-4c5f-9d4f-bd8d866b8088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:56.449732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f2d9-7267-4c5f-9d4f-bd8d866b8088 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:56.450234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f2d9-7267-4c5f-9d4f-bd8d866b8088 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:56.450722 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f2d9-7267-4c5f-9d4f-bd8d866b8088 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:56.451635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634f2d9-7267-4c5f-9d4f-bd8d866b8088 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:56.452168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634f2d9-7267-4c5f-9d4f-bd8d866b8088 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:56.453956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634f2d9-7267-4c5f-9d4f-bd8d866b8088 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:56.459852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 398/789] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:25:56 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:56.544082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71aed-13e7-4bbb-92f8-7a69760e6cab None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:56.544421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71aed-13e7-4bbb-92f8-7a69760e6cab None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:56.544643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71aed-13e7-4bbb-92f8-7a69760e6cab None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:56.546625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 392/790] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:56.553100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf2a5-f1c7-49a0-b091-0fd45ddfe1a5 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:56.553410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf2a5-f1c7-49a0-b091-0fd45ddfe1a5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:56.553669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf2a5-f1c7-49a0-b091-0fd45ddfe1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:56.572582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3babf2a5-f1c7-49a0-b091-0fd45ddfe1a5 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:56.573781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3babf2a5-f1c7-49a0-b091-0fd45ddfe1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:56.587861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 399/791] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:56 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:56.606644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71aed-13e7-4bbb-92f8-7a69760e6cab None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:56.619209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71aed-13e7-4bbb-92f8-7a69760e6cab None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:56.624532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e04e05-76d5-413c-b00f-f4649e4617a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:56.624532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04e05-76d5-413c-b00f-f4649e4617a9 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:56.624532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04e05-76d5-413c-b00f-f4649e4617a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:56.624803 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04e05-76d5-413c-b00f-f4649e4617a9 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:56.625334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e04e05-76d5-413c-b00f-f4649e4617a9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:56.626951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e04e05-76d5-413c-b00f-f4649e4617a9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:56.643162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 393/792] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:25:56 2021] POST /identity/v3/services => generated 251 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:57.342084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b46e0e-4601-45de-b1c2-20df4923f882 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.342593 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b46e0e-4601-45de-b1c2-20df4923f882 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.342667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b46e0e-4601-45de-b1c2-20df4923f882 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.344694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 400/793] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:57.351266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2ecd-d4d6-4bb2-bd47-aa2f91634e84 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.351740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2ecd-d4d6-4bb2-bd47-aa2f91634e84 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.351832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2ecd-d4d6-4bb2-bd47-aa2f91634e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.369821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5d4f2ecd-d4d6-4bb2-bd47-aa2f91634e84 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:57.370963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5d4f2ecd-d4d6-4bb2-bd47-aa2f91634e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:57.387113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 394/794] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:57 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:57.410498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b46e0e-4601-45de-b1c2-20df4923f882 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.423531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b46e0e-4601-45de-b1c2-20df4923f882 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.428548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.429386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.429664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.429937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.430695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.432441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.444948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:25:57.446587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 401/795] 10.222.0.16 () {56 vars in 1154 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:57.453224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2ecd-d4d6-4bb2-bd47-aa2f91634e84 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.462380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2ecd-d4d6-4bb2-bd47-aa2f91634e84 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.466960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8530f0-10c6-41c0-81a3-0bb70717b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.467617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8530f0-10c6-41c0-81a3-0bb70717b63b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.467930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8530f0-10c6-41c0-81a3-0bb70717b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.468203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8530f0-10c6-41c0-81a3-0bb70717b63b admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.468907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8530f0-10c6-41c0-81a3-0bb70717b63b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:57.469208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8530f0-10c6-41c0-81a3-0bb70717b63b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.470866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8530f0-10c6-41c0-81a3-0bb70717b63b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.476181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 395/796] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:57.482291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.486563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb0af-09b2-4f40-8f65-60bc625de9ed None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.487093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb0af-09b2-4f40-8f65-60bc625de9ed None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.487375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb0af-09b2-4f40-8f65-60bc625de9ed None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.490407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 396/797] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:57.491841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ef272-9480-418c-bf0b-3943aededca3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.496233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.496478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dbef4-4857-473e-92ec-a5854471dfac None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.496743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dbef4-4857-473e-92ec-a5854471dfac None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.496910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.497063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dbef4-4857-473e-92ec-a5854471dfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.497202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.497407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.498113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:57.498415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.500141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.505618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 402/798] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:57.512531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.516291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c71dbef4-4857-473e-92ec-a5854471dfac None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:57.517629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c71dbef4-4857-473e-92ec-a5854471dfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:57.521320 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eecae-f139-4ffd-9b77-142dcfbfda5f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.525792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.526433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.526710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.526895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 397/799] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:57 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:57.527061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.527776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] RBAC: Adding query filter params (interface=public, service_id=a0480960b0044d8ea34b8767504fa332, region_id=RegionOne) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:57.528081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.529654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.536316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 403/800] 10.222.0.16 () {56 vars in 1273 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/endpoints?service_id=a0480960b0044d8ea34b8767504fa332&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:25:57.542789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dbef4-4857-473e-92ec-a5854471dfac None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.551822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dbef4-4857-473e-92ec-a5854471dfac None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.554558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.556584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a16a9c-2e4a-400f-8d35-07d316c4c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.557298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a16a9c-2e4a-400f-8d35-07d316c4c27a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.557579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a16a9c-2e4a-400f-8d35-07d316c4c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.557852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a16a9c-2e4a-400f-8d35-07d316c4c27a admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.558723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a16a9c-2e4a-400f-8d35-07d316c4c27a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.560432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a16a9c-2e4a-400f-8d35-07d316c4c27a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.565042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd081b-ccbb-4269-a4f3-3552c4e68e33 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.566591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 398/801] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/services => generated 1268 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:25:57.569931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a780f-4037-4319-b4c6-008cf830e3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.570764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a780f-4037-4319-b4c6-008cf830e3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.571044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a780f-4037-4319-b4c6-008cf830e3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.571316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a780f-4037-4319-b4c6-008cf830e3d0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.584492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a780f-4037-4319-b4c6-008cf830e3d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:25:57.592360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-289a780f-4037-4319-b4c6-008cf830e3d0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:25:57.593990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 404/802] 10.222.0.16 () {56 vars in 1142 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:25:57.601321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a16a9c-2e4a-400f-8d35-07d316c4c27a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.611189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a16a9c-2e4a-400f-8d35-07d316c4c27a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.616553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.617149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.617436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.617717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.618489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:57.618797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.620541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.630384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 399/803] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:57.636990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a780f-4037-4319-b4c6-008cf830e3d0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.647505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a780f-4037-4319-b4c6-008cf830e3d0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.652102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.652915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.653201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.653478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.666022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.667944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.685961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:57.687543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 405/804] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:57.694135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.703876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd6dbf-6cd5-4342-83cf-4a245ae27776 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.708594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.709841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.710128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.710407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.711171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:57.711478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.713264 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.728428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 400/805] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:57.734576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.744451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c64e-b44c-4e8a-b8b6-9c58ff0be50d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.748704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.749516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.749798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.750074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.757832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.759896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.775081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:25:57.776600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 406/806] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:57.782887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.792886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e9fa-37a8-4b6f-a2e7-837c2a8a1d79 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.797395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.798071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.798388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.798678 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.799524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:57.799909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.801841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.821244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 401/807] 10.222.0.16 () {56 vars in 1171 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:57.827384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.837774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b2b73-9bea-4c2f-87dd-83ee9fd8cd37 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.842653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.843498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.843809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.844136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.855335 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.857335 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.876686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:25:57.878289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 407/808] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:57.884608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.894122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e2992-3d4c-4e18-8e58-ecca183b19ee admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.899390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.900030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.900368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.900645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.901367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:57.901728 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.903397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.916454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 402/809] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:57.922652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.935425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb43ce-3633-4c6d-8d55-1f653a931ea8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.940161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.941009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.941293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.941565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.949294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.951340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:57.965497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:25:57.967051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 408/810] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:57.973516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:57.983492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cc7ee-d05d-4642-9f7c-e722f021977d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:57.988013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc302f91-f499-4988-bd70-378adf554d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:57.988715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc302f91-f499-4988-bd70-378adf554d5f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:57.989052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc302f91-f499-4988-bd70-378adf554d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:57.989335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc302f91-f499-4988-bd70-378adf554d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:57.990793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc302f91-f499-4988-bd70-378adf554d5f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:57.991101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc302f91-f499-4988-bd70-378adf554d5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:57.993107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc302f91-f499-4988-bd70-378adf554d5f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:58.005695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 403/811] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:25:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:58.012819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:58.023305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b528-3be0-4303-81ce-04abc1c9ec13 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:58.028464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ff321-0a13-4067-b38f-5a4375130977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:58.029389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff321-0a13-4067-b38f-5a4375130977 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:58.029673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff321-0a13-4067-b38f-5a4375130977 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:58.030135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff321-0a13-4067-b38f-5a4375130977 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/e17902fcace54636bd031101c4672759/roles/03ae1df3911a446f8243e54b57bfb293` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:58.032583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff321-0a13-4067-b38f-5a4375130977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=e17902fcace54636bd031101c4672759, role_id=03ae1df3911a446f8243e54b57bfb293)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:58.035350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff321-0a13-4067-b38f-5a4375130977 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:58.052495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 409/812] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:25:58 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/e17902fcace54636bd031101c4672759/roles/03ae1df3911a446f8243e54b57bfb293 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:25:58.763612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7011-bdd9-4c70-b891-1e9e9c4455be None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:58.764312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7011-bdd9-4c70-b891-1e9e9c4455be None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:58.764312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7011-bdd9-4c70-b891-1e9e9c4455be None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:58.766148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 404/813] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:58.773004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343069b3-fd50-4c99-9442-cb21b5b1408f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:58.773534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343069b3-fd50-4c99-9442-cb21b5b1408f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:58.773534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343069b3-fd50-4c99-9442-cb21b5b1408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:58.791993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-343069b3-fd50-4c99-9442-cb21b5b1408f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:58.793172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-343069b3-fd50-4c99-9442-cb21b5b1408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:58.857340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 410/814] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:58 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:58.881749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc7011-bdd9-4c70-b891-1e9e9c4455be None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:58.884245 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2816c7-9cea-4bc0-9081-3386a68812b9 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:58.884534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2816c7-9cea-4bc0-9081-3386a68812b9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:58.884809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2816c7-9cea-4bc0-9081-3386a68812b9 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:58.886837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 411/815] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:25:58.892953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04980-24cf-4eda-8868-901cf3d803bd None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:58.893242 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04980-24cf-4eda-8868-901cf3d803bd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:58.893514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04980-24cf-4eda-8868-901cf3d803bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:58.893932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc7011-bdd9-4c70-b891-1e9e9c4455be None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:58.898192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c896e-593f-4585-b4da-fd3f0512cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:58.898849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c896e-593f-4585-b4da-fd3f0512cc64 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:58.899134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c896e-593f-4585-b4da-fd3f0512cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:58.899409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c896e-593f-4585-b4da-fd3f0512cc64 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:58.900159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c896e-593f-4585-b4da-fd3f0512cc64 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:58.901772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c896e-593f-4585-b4da-fd3f0512cc64 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:58.912802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-efc04980-24cf-4eda-8868-901cf3d803bd None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:58.914381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-efc04980-24cf-4eda-8868-901cf3d803bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:58.920190 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 405/816] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:25:58 2021] POST /identity/v3/services => generated 241 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:25:58.934876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 412/817] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:58 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:25:58.959468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c896e-593f-4585-b4da-fd3f0512cc64 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:58.970212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c896e-593f-4585-b4da-fd3f0512cc64 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:58.975252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:58.976209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:58.976502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:58.976774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:58.977488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:58.979203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:58.991911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:25:58.993527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 406/818] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:58 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:59.000265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc04980-24cf-4eda-8868-901cf3d803bd None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:59.010036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc04980-24cf-4eda-8868-901cf3d803bd None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:59.015033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:59.016016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.016519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.016995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.018001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:59.018530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:59.020467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:59.026543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 413/819] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:58 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:59.033614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:59.044238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735161-1df2-445a-bd2c-31d25e7cebe5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:59.048896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:59.049655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.049941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.050216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.050993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:59.051300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:59.053575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:59.059626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 407/820] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:25:59 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:59.066580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:59.076583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3aae6-3067-4007-b68a-2d9bce8ed4b4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:59.081394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00c483-6a73-4ca4-baa2-689149516a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:59.082316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c483-6a73-4ca4-baa2-689149516a39 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.082802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c483-6a73-4ca4-baa2-689149516a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.083342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c483-6a73-4ca4-baa2-689149516a39 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.084571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00c483-6a73-4ca4-baa2-689149516a39 admin admin] RBAC: Adding query filter params (interface=public, service_id=7ecb46c3875948a6bfe7f549083872dc, region_id=RegionOne) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:59.085110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00c483-6a73-4ca4-baa2-689149516a39 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:59.086910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00c483-6a73-4ca4-baa2-689149516a39 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:59.094054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 414/821] 10.222.0.16 () {56 vars in 1273 bytes} [Wed Jul 28 03:25:59 2021] GET /identity/v3/endpoints?service_id=7ecb46c3875948a6bfe7f549083872dc&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:59.100704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:59.111221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28837e-1256-4c77-929c-de26f020b04c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:59.116273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32a08c-9cb3-4e07-b8a3-0e60bf71bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:59.116934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32a08c-9cb3-4e07-b8a3-0e60bf71bd69 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.117270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32a08c-9cb3-4e07-b8a3-0e60bf71bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.117495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32a08c-9cb3-4e07-b8a3-0e60bf71bd69 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.118200 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32a08c-9cb3-4e07-b8a3-0e60bf71bd69 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:59.121773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32a08c-9cb3-4e07-b8a3-0e60bf71bd69 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:59.127856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 408/822] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:25:59 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:25:59.788627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0355-af88-48d6-ba8b-3685705151e4 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.789652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0355-af88-48d6-ba8b-3685705151e4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.790261 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0355-af88-48d6-ba8b-3685705151e4 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.792520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 415/823] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:25:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:25:59.798755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeacb75-d8cb-49b5-a954-3d4cd990c43d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.799593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeacb75-d8cb-49b5-a954-3d4cd990c43d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.800108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeacb75-d8cb-49b5-a954-3d4cd990c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.820174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1eeacb75-d8cb-49b5-a954-3d4cd990c43d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:25:59.821349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1eeacb75-d8cb-49b5-a954-3d4cd990c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:25:59.828908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 409/824] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:25:59 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:25:59.854538 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0355-af88-48d6-ba8b-3685705151e4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:59.867481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0355-af88-48d6-ba8b-3685705151e4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:59.872051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:59.873176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.873677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.874156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.875008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:59.876868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:59.889196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:25:59.891074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 416/825] 10.222.0.16 () {56 vars in 1154 bytes} [Wed Jul 28 03:25:59 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:25:59.898358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeacb75-d8cb-49b5-a954-3d4cd990c43d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:59.906859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeacb75-d8cb-49b5-a954-3d4cd990c43d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:59.911185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:59.911876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.912328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.912610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.913313 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:59.913618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:59.915205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:59.920392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 410/826] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:25:59 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:59.926681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:59.937090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9b275-cb14-44ce-941e-aa1d0f3d4e23 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:59.941905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2ccbd-99f9-42c3-a742-2a54dd4288cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:59.942799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ccbd-99f9-42c3-a742-2a54dd4288cf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.943362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ccbd-99f9-42c3-a742-2a54dd4288cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.943880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ccbd-99f9-42c3-a742-2a54dd4288cf admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.944795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2ccbd-99f9-42c3-a742-2a54dd4288cf admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:25:59.945340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2ccbd-99f9-42c3-a742-2a54dd4288cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:59.947333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2ccbd-99f9-42c3-a742-2a54dd4288cf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:25:59.953448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 417/827] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:25:59 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:25:59.960538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:25:59.970442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87465-515b-4f55-8e42-2af5d54b17d4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:25:59.975194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ced1b-671c-408f-a7ce-7cc5b5d59887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:25:59.976212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ced1b-671c-408f-a7ce-7cc5b5d59887 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:25:59.976735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ced1b-671c-408f-a7ce-7cc5b5d59887 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:25:59.977231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ced1b-671c-408f-a7ce-7cc5b5d59887 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:25:59.978176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ced1b-671c-408f-a7ce-7cc5b5d59887 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:25:59.980090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ced1b-671c-408f-a7ce-7cc5b5d59887 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.004438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 411/828] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:25:59 2021] POST /identity/v3/endpoints => generated 347 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:26:00.316438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2de8-f5bc-43a9-8902-327773301ca4 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.316800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2de8-f5bc-43a9-8902-327773301ca4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.317002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2de8-f5bc-43a9-8902-327773301ca4 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.319643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 418/829] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:00.325631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fd3a-5e84-4d73-acf0-a6bcd5af0948 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.325929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fd3a-5e84-4d73-acf0-a6bcd5af0948 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.326211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fd3a-5e84-4d73-acf0-a6bcd5af0948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.344375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-db84fd3a-5e84-4d73-acf0-a6bcd5af0948 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:00.345593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-db84fd3a-5e84-4d73-acf0-a6bcd5af0948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:00.367923 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 412/830] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:00 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:00.389295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf2de8-f5bc-43a9-8902-327773301ca4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.401092 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf2de8-f5bc-43a9-8902-327773301ca4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.405328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca8ef-089c-4bfd-adf6-73cfec22a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.406125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca8ef-089c-4bfd-adf6-73cfec22a03b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.406406 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca8ef-089c-4bfd-adf6-73cfec22a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.406678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca8ef-089c-4bfd-adf6-73cfec22a03b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.418297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ca8ef-089c-4bfd-adf6-73cfec22a03b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:00.425568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-355ca8ef-089c-4bfd-adf6-73cfec22a03b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:26:00.431818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 419/831] 10.222.0.16 () {56 vars in 1142 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:00.434211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84fd3a-5e84-4d73-acf0-a6bcd5af0948 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.442575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84fd3a-5e84-4d73-acf0-a6bcd5af0948 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.447196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.447971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.448253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.448525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.449322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:00.449662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.451274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.463884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 413/832] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:00.466680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca8ef-089c-4bfd-adf6-73cfec22a03b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.476779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca8ef-089c-4bfd-adf6-73cfec22a03b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.481196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.482034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.482318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.482647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.493647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.495565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.512750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:26:00.517912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 420/833] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:00.520555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.530023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701916f-40d9-4baa-be47-f20f25993759 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.534469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.535225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.535560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.535873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.536649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:00.537464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.539305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.555833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 414/834] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:00.557952 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.567240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43c1b-cf25-4f17-b4d0-3399608637ed admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.572633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.573479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.573764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.574040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.581352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.583379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.598185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:26:00.603827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 421/835] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:00.606496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.616037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc3c49-743d-4887-bd98-23b8ebcf2f91 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.620557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.621222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.621559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.621835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.622727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:00.623035 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.624958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.647941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 415/836] 10.222.0.16 () {56 vars in 1171 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:00.649700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.659106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f891f-d5f4-4030-92f9-1832d3f9d586 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.663968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4435553-8288-412b-ae24-83a04b47d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.664656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435553-8288-412b-ae24-83a04b47d1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.664948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435553-8288-412b-ae24-83a04b47d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.665225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435553-8288-412b-ae24-83a04b47d1c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.673233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4435553-8288-412b-ae24-83a04b47d1c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.675054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4435553-8288-412b-ae24-83a04b47d1c9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.687830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 422/837] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:26:00.690746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.700325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6720116-23ca-476a-b47b-9abc33cfd92f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.704784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.705638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.705973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.706302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.719795 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.720085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.737844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:26:00.739654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 416/838] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:00.746269 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4435553-8288-412b-ae24-83a04b47d1c9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.754848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4435553-8288-412b-ae24-83a04b47d1c9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.759503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.760204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.760486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.760762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.761490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:00.761795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.763387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.781237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 423/839] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:00.782601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.795684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a6515-1600-400b-b6e4-d3baaff90f80 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.800417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.801930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.802359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.803313 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.810839 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.813052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.826315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:26:00.828049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 417/840] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:00.836899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.847054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e224-5441-4e3b-8110-fed15fea486c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.852218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe427c-76fd-406b-9a7b-46b9bc405e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.853196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe427c-76fd-406b-9a7b-46b9bc405e2f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.853627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe427c-76fd-406b-9a7b-46b9bc405e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.854050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe427c-76fd-406b-9a7b-46b9bc405e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.855053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe427c-76fd-406b-9a7b-46b9bc405e2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:00.855508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe427c-76fd-406b-9a7b-46b9bc405e2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.857620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe427c-76fd-406b-9a7b-46b9bc405e2f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.875834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 424/841] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:00.878347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:00.889543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca33c-81f8-44bf-9f24-b8ba4a6613a3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:00.894149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcdbbb-f5b2-49a5-bab4-9a6fc6a38b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:00.894981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcdbbb-f5b2-49a5-bab4-9a6fc6a38b52 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:00.895468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcdbbb-f5b2-49a5-bab4-9a6fc6a38b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:00.895919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcdbbb-f5b2-49a5-bab4-9a6fc6a38b52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:00.897196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcdbbb-f5b2-49a5-bab4-9a6fc6a38b52 admin admin] RBAC: Adding query filter params (role.id=03ae1df3911a446f8243e54b57bfb293, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=e17902fcace54636bd031101c4672759) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:00.897655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcdbbb-f5b2-49a5-bab4-9a6fc6a38b52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:00.899803 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcdbbb-f5b2-49a5-bab4-9a6fc6a38b52 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:00.912032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 418/842] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:00 2021] GET /identity/v3/role_assignments?user.id=e17902fcace54636bd031101c4672759&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=03ae1df3911a446f8243e54b57bfb293 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:01.142404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9924c-93c3-478c-bea2-401847681508 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.142707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9924c-93c3-478c-bea2-401847681508 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.142957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9924c-93c3-478c-bea2-401847681508 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.145001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 425/843] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:01.151113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1241-715c-43f1-93b6-e161b80e0699 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.151343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1241-715c-43f1-93b6-e161b80e0699 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.151621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1241-715c-43f1-93b6-e161b80e0699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.169280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-94fb1241-715c-43f1-93b6-e161b80e0699 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:01.170428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-94fb1241-715c-43f1-93b6-e161b80e0699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:01.178484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 419/844] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:01 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:01.202749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9924c-93c3-478c-bea2-401847681508 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.215498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9924c-93c3-478c-bea2-401847681508 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.219741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.220530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.220810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.221082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.221728 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.223312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.234627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:26:01.236111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 426/845] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:26:01 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:01.243109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb1241-715c-43f1-93b6-e161b80e0699 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.251493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb1241-715c-43f1-93b6-e161b80e0699 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.256326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.257041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.257359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.257638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.258338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:01.258638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.260247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.265295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 420/846] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:26:01 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:01.272165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.281439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fa4eb-8c29-4007-ab9e-4114ab970f59 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.285773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.286470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.286748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.287108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.287968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:01.288272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.289914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.295323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 427/847] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:26:01 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:01.301820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.311624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab78bb-7968-44ce-adbf-49909786ea22 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.316391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca50b65-445d-4bce-9c93-a8358e9dc55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.317078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50b65-445d-4bce-9c93-a8358e9dc55b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.317406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50b65-445d-4bce-9c93-a8358e9dc55b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.317683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50b65-445d-4bce-9c93-a8358e9dc55b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.319291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca50b65-445d-4bce-9c93-a8358e9dc55b admin admin] RBAC: Adding query filter params (interface=public, service_id=b693009b23d8459b80354b835f64a3ae, region_id=RegionOne) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:01.319654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca50b65-445d-4bce-9c93-a8358e9dc55b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.321508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca50b65-445d-4bce-9c93-a8358e9dc55b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.328086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 421/848] 10.222.0.16 () {56 vars in 1273 bytes} [Wed Jul 28 03:26:01 2021] GET /identity/v3/endpoints?service_id=b693009b23d8459b80354b835f64a3ae&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:01.335052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.344935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2e39-ae64-4ed6-b1a9-f74ed758e113 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.349945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d9ffd-2853-49a6-93e3-c8f4f0545061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.350641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d9ffd-2853-49a6-93e3-c8f4f0545061 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.350919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d9ffd-2853-49a6-93e3-c8f4f0545061 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.351191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d9ffd-2853-49a6-93e3-c8f4f0545061 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.351912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d9ffd-2853-49a6-93e3-c8f4f0545061 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.353513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d9ffd-2853-49a6-93e3-c8f4f0545061 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.360314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 428/849] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:26:01 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:26:01.394950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182c3f-11e0-4c41-b296-c3b29dd28763 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.395312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182c3f-11e0-4c41-b296-c3b29dd28763 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.395591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182c3f-11e0-4c41-b296-c3b29dd28763 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.398438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 422/850] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:01.405065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947b50-2ede-4ff1-ac0a-bbf63752f3a0 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.405328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947b50-2ede-4ff1-ac0a-bbf63752f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.405543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947b50-2ede-4ff1-ac0a-bbf63752f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.424473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b9947b50-2ede-4ff1-ac0a-bbf63752f3a0 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:01.425649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b9947b50-2ede-4ff1-ac0a-bbf63752f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:01.433960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 429/851] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:01 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:01.458426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62182c3f-11e0-4c41-b296-c3b29dd28763 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.471220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62182c3f-11e0-4c41-b296-c3b29dd28763 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.475778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.476587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.476866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.477136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.477847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.479506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.491902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:26:01.493537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 423/852] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:26:01 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:01.500020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9947b50-2ede-4ff1-ac0a-bbf63752f3a0 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.509818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9947b50-2ede-4ff1-ac0a-bbf63752f3a0 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.514311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.515052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.515337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.515630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.516410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:01.516716 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.518384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.530033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 430/853] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:26:01 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:01.531414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.541513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4c44-e8d9-46bd-9b11-92833d0f50bd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.547528 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedba0c-97a8-4cc1-80bb-34bd1a516890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.548204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedba0c-97a8-4cc1-80bb-34bd1a516890 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.548476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedba0c-97a8-4cc1-80bb-34bd1a516890 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.548746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedba0c-97a8-4cc1-80bb-34bd1a516890 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.549446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedba0c-97a8-4cc1-80bb-34bd1a516890 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:01.549741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedba0c-97a8-4cc1-80bb-34bd1a516890 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.551318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedba0c-97a8-4cc1-80bb-34bd1a516890 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.557037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 424/854] 10.222.0.16 () {56 vars in 1136 bytes} [Wed Jul 28 03:26:01 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:01.563066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:01.572443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8852f4c-b18a-417a-ad51-71ddaf403ba1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:01.576796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da3111-4e11-4240-a07d-f1d65952b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:01.577443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3111-4e11-4240-a07d-f1d65952b44d admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:01.577724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3111-4e11-4240-a07d-f1d65952b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:01.577994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3111-4e11-4240-a07d-f1d65952b44d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:01.578731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da3111-4e11-4240-a07d-f1d65952b44d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:01.579743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-75da3111-4e11-4240-a07d-f1d65952b44d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:26:01.579743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:26:01.579743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:26:01.580618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da3111-4e11-4240-a07d-f1d65952b44d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:01.602135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 431/855] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:26:01 2021] POST /identity/v3/endpoints => generated 346 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:26:02.347492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a186-53f4-43c3-8b60-a23dacb8bc5e None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:02.348204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a186-53f4-43c3-8b60-a23dacb8bc5e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:02.348204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a186-53f4-43c3-8b60-a23dacb8bc5e None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:02.350918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 425/856] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:02.357014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ef29-d620-4f9f-8682-2892aadda412 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:02.357537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ef29-d620-4f9f-8682-2892aadda412 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:02.357703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ef29-d620-4f9f-8682-2892aadda412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:02.375527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-0591ef29-d620-4f9f-8682-2892aadda412 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:02.376346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0591ef29-d620-4f9f-8682-2892aadda412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:02.392456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 432/857] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:02 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:02.416810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5a186-53f4-43c3-8b60-a23dacb8bc5e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:02.429281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5a186-53f4-43c3-8b60-a23dacb8bc5e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:02.433621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:02.434412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:02.434693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:02.434969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:02.435618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:02.437252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:02.448407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:26:02.449915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 426/858] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:26:02 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:02.456418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ef29-d620-4f9f-8682-2892aadda412 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:02.465772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ef29-d620-4f9f-8682-2892aadda412 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:02.470233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487ef3d-3e6d-499b-bc04-3b7be7b64ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:02.470895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ef3d-3e6d-499b-bc04-3b7be7b64ccb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:02.471180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ef3d-3e6d-499b-bc04-3b7be7b64ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:02.471500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ef3d-3e6d-499b-bc04-3b7be7b64ccb admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:02.472251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487ef3d-3e6d-499b-bc04-3b7be7b64ccb admin admin] RBAC: Adding query filter params (name=compute) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:02.472601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487ef3d-3e6d-499b-bc04-3b7be7b64ccb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:02.474223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487ef3d-3e6d-499b-bc04-3b7be7b64ccb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:02.480395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 433/859] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:26:02 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:02.486305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:02.496898 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b436d-f732-41d0-a8df-715a2e28448d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:02.501379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c265-2a78-4f19-93f7-6bb2596a80be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:02.502037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c265-2a78-4f19-93f7-6bb2596a80be admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:02.502321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c265-2a78-4f19-93f7-6bb2596a80be admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:02.502602 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c265-2a78-4f19-93f7-6bb2596a80be admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:02.503308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c265-2a78-4f19-93f7-6bb2596a80be admin admin] RBAC: Adding query filter params (type=compute) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:02.503614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c265-2a78-4f19-93f7-6bb2596a80be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:02.505252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c265-2a78-4f19-93f7-6bb2596a80be admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:02.510612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 427/860] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:26:02 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:03.152434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebc557-3939-4b6e-981d-09e1def40bc1 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.152721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebc557-3939-4b6e-981d-09e1def40bc1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.152997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebc557-3939-4b6e-981d-09e1def40bc1 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.155023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 434/861] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:03.160894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f2eca-7bf6-4583-b8b5-6fa7017b97f4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.161180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f2eca-7bf6-4583-b8b5-6fa7017b97f4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.161453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f2eca-7bf6-4583-b8b5-6fa7017b97f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.181753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-fd1f2eca-7bf6-4583-b8b5-6fa7017b97f4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:03.182893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fd1f2eca-7bf6-4583-b8b5-6fa7017b97f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:03.190386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 428/862] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:03 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:03.214720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebc557-3939-4b6e-981d-09e1def40bc1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.226756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebc557-3939-4b6e-981d-09e1def40bc1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.230951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.231747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.232030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.232299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] PATH_INFO: `/v3/services/image` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.232942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:03.234540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:03.245939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:26:03.247396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 435/863] 10.222.0.16 () {56 vars in 1127 bytes} [Wed Jul 28 03:26:03 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:03.253916 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f2eca-7bf6-4583-b8b5-6fa7017b97f4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.262633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f2eca-7bf6-4583-b8b5-6fa7017b97f4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.266983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a74037-d471-45d6-affe-25ee4be4a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.267640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a74037-d471-45d6-affe-25ee4be4a6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.267947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a74037-d471-45d6-affe-25ee4be4a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.268216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a74037-d471-45d6-affe-25ee4be4a6c7 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.268912 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a74037-d471-45d6-affe-25ee4be4a6c7 admin admin] RBAC: Adding query filter params (name=image) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:03.269210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a74037-d471-45d6-affe-25ee4be4a6c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:03.270789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a74037-d471-45d6-affe-25ee4be4a6c7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:03.276295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 429/864] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:03 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:03.282521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.292380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705d07f-5498-4e7b-b387-3b19a39ba00c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.296716 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b4fb6-d0ac-4bbc-bf78-3c841c120750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.297373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4fb6-d0ac-4bbc-bf78-3c841c120750 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.297650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4fb6-d0ac-4bbc-bf78-3c841c120750 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.297923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4fb6-d0ac-4bbc-bf78-3c841c120750 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.298624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b4fb6-d0ac-4bbc-bf78-3c841c120750 admin admin] RBAC: Adding query filter params (type=image) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:03.298925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b4fb6-d0ac-4bbc-bf78-3c841c120750 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:03.300551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b4fb6-d0ac-4bbc-bf78-3c841c120750 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:03.305915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 436/865] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:03 2021] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:03.652226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9035-f586-4c96-baa3-4181731d66ed None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.652226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9035-f586-4c96-baa3-4181731d66ed None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.652226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b9035-f586-4c96-baa3-4181731d66ed None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.653271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 430/866] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:03.659559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2bd9-a711-46e7-8ff7-38a14933d9f5 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.660389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2bd9-a711-46e7-8ff7-38a14933d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.660899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2bd9-a711-46e7-8ff7-38a14933d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.679520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f4fb2bd9-a711-46e7-8ff7-38a14933d9f5 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:03.681054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f4fb2bd9-a711-46e7-8ff7-38a14933d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:03.688906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 437/867] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:03 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:03.714650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b9035-f586-4c96-baa3-4181731d66ed None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.726817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b9035-f586-4c96-baa3-4181731d66ed None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.731227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.732288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.732771 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.733270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.734128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:03.735947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:03.748097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:26:03.749780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 431/868] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:26:03 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:03.757243 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb2bd9-a711-46e7-8ff7-38a14933d9f5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.766339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb2bd9-a711-46e7-8ff7-38a14933d9f5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.770954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.771924 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.772474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.772992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.773927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:03.774622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:03.776521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:03.782749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 438/869] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:26:03 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:03.790049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.800293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc697e-fc0c-4114-84ed-6a198c178856 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.805823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f881bb-f67f-4d55-a134-4cf635b6b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.806880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f881bb-f67f-4d55-a134-4cf635b6b21d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.807523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f881bb-f67f-4d55-a134-4cf635b6b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.808051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f881bb-f67f-4d55-a134-4cf635b6b21d admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.808988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f881bb-f67f-4d55-a134-4cf635b6b21d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:03.809491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f881bb-f67f-4d55-a134-4cf635b6b21d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:03.811317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f881bb-f67f-4d55-a134-4cf635b6b21d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:03.817662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 432/870] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:26:03 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:03.824943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.835032 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebae1b9-51b7-4874-b400-1304dd5f7150 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.839851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e34630-d9af-4c81-8a4a-4c365158ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.840741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34630-d9af-4c81-8a4a-4c365158ce84 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.841224 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34630-d9af-4c81-8a4a-4c365158ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.841717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34630-d9af-4c81-8a4a-4c365158ce84 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.842658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e34630-d9af-4c81-8a4a-4c365158ce84 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:03.844580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e34630-d9af-4c81-8a4a-4c365158ce84 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:03.845989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73297d-f726-45c7-869e-0f02d6497498 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.846289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73297d-f726-45c7-869e-0f02d6497498 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.846569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73297d-f726-45c7-869e-0f02d6497498 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.849810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 433/871] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:26:03.854338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb743d33-662b-43e8-8c1c-bd3dd2c45b4b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.854656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb743d33-662b-43e8-8c1c-bd3dd2c45b4b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.855016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb743d33-662b-43e8-8c1c-bd3dd2c45b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.867486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 439/872] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:26:03 2021] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:26:03.873892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-cb743d33-662b-43e8-8c1c-bd3dd2c45b4b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:03.875084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cb743d33-662b-43e8-8c1c-bd3dd2c45b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:03.899860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 434/873] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:03 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:03.919072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e34630-d9af-4c81-8a4a-4c365158ce84 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.929981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e34630-d9af-4c81-8a4a-4c365158ce84 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.934535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.935223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.935506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.935810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:03.936532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:03.938413 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:03.939880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.common [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 03:26:03.960627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.sql.core [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 03:26:03.960627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 03:26:03.960627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [parameters: {'id': '4ae8702027c84592ae78e88210c0181d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 03:26:03.960627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=72579) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 03:26:03.968072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ae8702027c84592ae78e88210c0181d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ae8702027c84592ae78e88210c0181d. Jul 28 03:26:03.969824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 440/874] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Jul 28 03:26:03 2021] POST /identity/v3/projects => generated 262 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:03.976693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb743d33-662b-43e8-8c1c-bd3dd2c45b4b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:03.985795 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb743d33-662b-43e8-8c1c-bd3dd2c45b4b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:03.991067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fb2f7-43ab-4151-821c-ce15e5878260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:03.992077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb2f7-43ab-4151-821c-ce15e5878260 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:03.992361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb2f7-43ab-4151-821c-ce15e5878260 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:03.992638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb2f7-43ab-4151-821c-ce15e5878260 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:04.000541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fb2f7-43ab-4151-821c-ce15e5878260 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:04.002530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fb2f7-43ab-4151-821c-ce15e5878260 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:04.017724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-f25fb2f7-43ab-4151-821c-ce15e5878260 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:26:04.023885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 435/875] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:26:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:04.026935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:04.038860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d5181-e2c4-4c76-973a-1219d5e937eb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:04.045193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31501e1b-5f0c-4511-89c3-3c70aedf8b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:04.045937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31501e1b-5f0c-4511-89c3-3c70aedf8b67 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:04.046276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31501e1b-5f0c-4511-89c3-3c70aedf8b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:04.046556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31501e1b-5f0c-4511-89c3-3c70aedf8b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:04.047373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31501e1b-5f0c-4511-89c3-3c70aedf8b67 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:04.047759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31501e1b-5f0c-4511-89c3-3c70aedf8b67 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:04.050022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31501e1b-5f0c-4511-89c3-3c70aedf8b67 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:04.073425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 441/876] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:26:04 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:04.698375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce017-a7ff-4fe2-9270-9712518214f0 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:04.698917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce017-a7ff-4fe2-9270-9712518214f0 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:04.698917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce017-a7ff-4fe2-9270-9712518214f0 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:04.700954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 436/877] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:04.707022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d78271-a5d3-41ac-b7fc-83a60ead0b4b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:04.707425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d78271-a5d3-41ac-b7fc-83a60ead0b4b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:04.707591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d78271-a5d3-41ac-b7fc-83a60ead0b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:04.726968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-75d78271-a5d3-41ac-b7fc-83a60ead0b4b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:04.728498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-75d78271-a5d3-41ac-b7fc-83a60ead0b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:04.736200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 442/878] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:04 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:04.761149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce017-a7ff-4fe2-9270-9712518214f0 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:04.774083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce017-a7ff-4fe2-9270-9712518214f0 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:04.778326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5353f-59be-4c12-ada5-5d2a18e0a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:04.778973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5353f-59be-4c12-ada5-5d2a18e0a9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:04.779253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5353f-59be-4c12-ada5-5d2a18e0a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:04.779524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5353f-59be-4c12-ada5-5d2a18e0a9f3 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:04.780281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5353f-59be-4c12-ada5-5d2a18e0a9f3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:04.781883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5353f-59be-4c12-ada5-5d2a18e0a9f3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:04.801179 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 437/879] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:26:04 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:05.558565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924a4e-9b5e-49f5-b064-b7b2086fa487 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:05.558827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924a4e-9b5e-49f5-b064-b7b2086fa487 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:05.559096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924a4e-9b5e-49f5-b064-b7b2086fa487 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:05.560881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 443/880] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:05.566731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6217e-25ab-495c-abe7-d5a12a623a5e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:05.567017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6217e-25ab-495c-abe7-d5a12a623a5e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:05.567293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6217e-25ab-495c-abe7-d5a12a623a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:05.584559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-beb6217e-25ab-495c-abe7-d5a12a623a5e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:05.585694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-beb6217e-25ab-495c-abe7-d5a12a623a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:05.602408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 438/881] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:05 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:05.626023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2924a4e-9b5e-49f5-b064-b7b2086fa487 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:05.640811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2924a4e-9b5e-49f5-b064-b7b2086fa487 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:05.645188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47b9df-8ea7-4b63-9520-fb0282e2da3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:05.646096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47b9df-8ea7-4b63-9520-fb0282e2da3e admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:05.646597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47b9df-8ea7-4b63-9520-fb0282e2da3e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:05.647052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47b9df-8ea7-4b63-9520-fb0282e2da3e admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:05.647990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47b9df-8ea7-4b63-9520-fb0282e2da3e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:05.649768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47b9df-8ea7-4b63-9520-fb0282e2da3e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:05.665708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 444/882] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:26:05 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:06.180281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ce9ef-a1e4-4423-a84c-116b7e2078e9 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.180798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ce9ef-a1e4-4423-a84c-116b7e2078e9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.180896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ce9ef-a1e4-4423-a84c-116b7e2078e9 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.182833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 439/883] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:06.189119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbd30-b549-42a4-9de2-0b0e24d48653 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.189529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbd30-b549-42a4-9de2-0b0e24d48653 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.189701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbd30-b549-42a4-9de2-0b0e24d48653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.209791 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b4edbd30-b549-42a4-9de2-0b0e24d48653 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:06.210999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b4edbd30-b549-42a4-9de2-0b0e24d48653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:06.229973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 445/884] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:06 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:06.254139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ce9ef-a1e4-4423-a84c-116b7e2078e9 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:06.267593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ce9ef-a1e4-4423-a84c-116b7e2078e9 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:06.272546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:06.273608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.274090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.274558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.275399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:06.277239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:06.289012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:26:06.290829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 440/885] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:26:06 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:06.297189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edbd30-b549-42a4-9de2-0b0e24d48653 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:06.305787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edbd30-b549-42a4-9de2-0b0e24d48653 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:06.310309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:06.310971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.311253 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.311528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.312279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:06.312585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:06.314186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:06.320146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 446/886] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:26:06 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:06.326554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:06.336020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4061e-b6be-44a3-a26c-9d0b19a0d69e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:06.340921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:06.341820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.342314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.342801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.343735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:06.344265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:06.346084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:06.352352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 441/887] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:26:06 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:06.359203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:06.369948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d6919-1864-4f74-b738-b67a88365473 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:06.375209 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ebfbc-3079-4ff6-b616-8d7475c65e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:06.376281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ebfbc-3079-4ff6-b616-8d7475c65e15 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.376783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ebfbc-3079-4ff6-b616-8d7475c65e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.377265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ebfbc-3079-4ff6-b616-8d7475c65e15 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.378325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ebfbc-3079-4ff6-b616-8d7475c65e15 admin admin] RBAC: Adding query filter params (interface=admin, service_id=b693009b23d8459b80354b835f64a3ae, region_id=RegionOne) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:06.378874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ebfbc-3079-4ff6-b616-8d7475c65e15 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:06.380839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ebfbc-3079-4ff6-b616-8d7475c65e15 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:06.387419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 447/888] 10.222.0.16 () {56 vars in 1271 bytes} [Wed Jul 28 03:26:06 2021] GET /identity/v3/endpoints?service_id=b693009b23d8459b80354b835f64a3ae&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:06.394296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:06.404631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961c6f7-3836-4e33-9e18-acfc490fe99b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:06.409576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c9dd3-9a63-41bd-a2a3-daef04fc72a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:06.410476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c9dd3-9a63-41bd-a2a3-daef04fc72a9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.410976 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c9dd3-9a63-41bd-a2a3-daef04fc72a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.411477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c9dd3-9a63-41bd-a2a3-daef04fc72a9 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.413086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c9dd3-9a63-41bd-a2a3-daef04fc72a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:06.414900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c9dd3-9a63-41bd-a2a3-daef04fc72a9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:06.422280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 442/889] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:26:06 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:26:06.435057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3c55-da8f-455f-bae1-dd65f60ed834 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.435349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3c55-da8f-455f-bae1-dd65f60ed834 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.435606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3c55-da8f-455f-bae1-dd65f60ed834 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.437640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 448/890] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:06.444633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22536152-b30f-4e2e-98a3-75fa732c77cb None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.444952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22536152-b30f-4e2e-98a3-75fa732c77cb None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.445194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22536152-b30f-4e2e-98a3-75fa732c77cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.464600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-22536152-b30f-4e2e-98a3-75fa732c77cb None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:06.465780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-22536152-b30f-4e2e-98a3-75fa732c77cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:06.473557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 443/891] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:06 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:06.500282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e3c55-da8f-455f-bae1-dd65f60ed834 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:06.512989 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e3c55-da8f-455f-bae1-dd65f60ed834 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:06.517700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:06.518654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.519135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.519599 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.520543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:06.522859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:06.538210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.sql.core [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 03:26:06.538210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 03:26:06.538210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [parameters: {'user_id': '215a3e63395948f1b81775ed4b623ed5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 03:26:06.538210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=72579) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 03:26:06.545181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 03:26:06.547208 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 449/892] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:26:06 2021] POST /identity/v3/users => generated 160 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:06.554693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22536152-b30f-4e2e-98a3-75fa732c77cb None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:06.564066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22536152-b30f-4e2e-98a3-75fa732c77cb None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:06.569551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c59b0-1b50-4981-873a-26684ead6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:06.570619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c59b0-1b50-4981-873a-26684ead6c13 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.571041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c59b0-1b50-4981-873a-26684ead6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.571476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c59b0-1b50-4981-873a-26684ead6c13 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.580039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c59b0-1b50-4981-873a-26684ead6c13 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:06.582321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c59b0-1b50-4981-873a-26684ead6c13 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:06.598166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d41c59b0-1b50-4981-873a-26684ead6c13 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:26:06.600024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 444/893] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:06 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:06.606772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:06.617703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98729da-0034-49e7-b483-d2ee53499de4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:06.622314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919bb7-d492-4287-85f5-ad7a384e558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:06.623077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919bb7-d492-4287-85f5-ad7a384e558e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:06.623435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919bb7-d492-4287-85f5-ad7a384e558e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:06.623824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919bb7-d492-4287-85f5-ad7a384e558e admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:06.625436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51919bb7-d492-4287-85f5-ad7a384e558e admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:06.625436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51919bb7-d492-4287-85f5-ad7a384e558e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:06.627420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51919bb7-d492-4287-85f5-ad7a384e558e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:06.668850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 450/894] 10.222.0.16 () {56 vars in 1123 bytes} [Wed Jul 28 03:26:06 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:07.217266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a61d6e-6c0d-4b35-afbb-78b06396f1a8 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.217796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a61d6e-6c0d-4b35-afbb-78b06396f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.217796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a61d6e-6c0d-4b35-afbb-78b06396f1a8 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.219741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 445/895] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:07.225888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f401da-90d1-458f-925b-86c047ac2425 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.226275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f401da-90d1-458f-925b-86c047ac2425 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.226443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f401da-90d1-458f-925b-86c047ac2425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.243956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-85f401da-90d1-458f-925b-86c047ac2425 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:07.245433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-85f401da-90d1-458f-925b-86c047ac2425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:07.252761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 451/896] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:07 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:07.277317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a61d6e-6c0d-4b35-afbb-78b06396f1a8 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:07.289379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a61d6e-6c0d-4b35-afbb-78b06396f1a8 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:07.293473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:07.294245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.294529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.294824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.295445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:07.297054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:07.307673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:26:07.309009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 446/897] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:26:07 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:07.315352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f401da-90d1-458f-925b-86c047ac2425 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:07.324239 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f401da-90d1-458f-925b-86c047ac2425 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:07.328447 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:07.329103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.329385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.329660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.330364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:07.330667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:07.332289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:07.338774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 452/898] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:26:07 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:07.345019 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:07.354540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d628300-fe2e-4e75-8a70-3641e6887386 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:07.358692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:07.359344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.359619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.359939 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.360641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:07.360943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:07.362517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:07.368134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 447/899] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:26:07 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:07.374473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:07.384342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b30648-f101-4702-a831-09a77cbbdd23 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:07.388545 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418fb08-c132-445d-b25e-57da66b23e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:07.389187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418fb08-c132-445d-b25e-57da66b23e8f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.389468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418fb08-c132-445d-b25e-57da66b23e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.389738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418fb08-c132-445d-b25e-57da66b23e8f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.390543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418fb08-c132-445d-b25e-57da66b23e8f admin admin] RBAC: Adding query filter params (interface=public, service_id=d509a8fd73504785b55548a6ccde3a8a, region_id=RegionOne) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:07.390850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418fb08-c132-445d-b25e-57da66b23e8f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:07.392470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418fb08-c132-445d-b25e-57da66b23e8f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:07.397774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 453/900] 10.222.0.16 () {56 vars in 1273 bytes} [Wed Jul 28 03:26:07 2021] GET /identity/v3/endpoints?service_id=d509a8fd73504785b55548a6ccde3a8a&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:07.403828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:07.412778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0e396-a88b-45b7-b2f0-c36c68449991 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:07.416938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556b55-18be-4e94-9c67-317b9ce7fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:07.417591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556b55-18be-4e94-9c67-317b9ce7fd9e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.417870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556b55-18be-4e94-9c67-317b9ce7fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.418146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556b55-18be-4e94-9c67-317b9ce7fd9e admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.418823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556b55-18be-4e94-9c67-317b9ce7fd9e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:07.420449 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556b55-18be-4e94-9c67-317b9ce7fd9e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:07.431760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 448/901] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:26:07 2021] GET /identity/v3/services => generated 1957 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:26:07.946269 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720138-6fad-415c-a1c6-b6865dedd088 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.946643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720138-6fad-415c-a1c6-b6865dedd088 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.946853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720138-6fad-415c-a1c6-b6865dedd088 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.948665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 454/902] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:07.954494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d62c-8f66-4509-b05d-95cc9da0a7c3 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:07.954778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d62c-8f66-4509-b05d-95cc9da0a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:07.955050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d62c-8f66-4509-b05d-95cc9da0a7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:07.973708 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6fd2d62c-8f66-4509-b05d-95cc9da0a7c3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:07.976785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6fd2d62c-8f66-4509-b05d-95cc9da0a7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:07.984213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 449/903] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:07 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:08.008287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc720138-6fad-415c-a1c6-b6865dedd088 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.019731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc720138-6fad-415c-a1c6-b6865dedd088 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.024432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.025203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.025558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.025734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] PATH_INFO: `/v3/services/image` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.026378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.028410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.040347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:26:08.041687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 455/904] 10.222.0.16 () {56 vars in 1127 bytes} [Wed Jul 28 03:26:08 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:08.048018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d62c-8f66-4509-b05d-95cc9da0a7c3 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.057132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d62c-8f66-4509-b05d-95cc9da0a7c3 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.061470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.062199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.062560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.062903 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.063678 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] RBAC: Adding query filter params (name=image) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:08.064098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.065756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.071245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 450/905] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:08 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:08.077415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.087112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63a916-fcdd-4018-ad12-f6e2d24cbe23 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.091644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.092326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.092612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.092892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.093598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] RBAC: Adding query filter params (type=image) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:08.093905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.095499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.100680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 456/906] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:08 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:08.107171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.116760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8010d9f-b8fe-47a4-98a8-892faf9b8825 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.124108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c112e8-72f9-4ca6-b4dc-cde163d4a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.124775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c112e8-72f9-4ca6-b4dc-cde163d4a92a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.125158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c112e8-72f9-4ca6-b4dc-cde163d4a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.125530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c112e8-72f9-4ca6-b4dc-cde163d4a92a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.126436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c112e8-72f9-4ca6-b4dc-cde163d4a92a admin admin] RBAC: Adding query filter params (interface=public, service_id=85a2dd8955bc4674934d160ad901388a, region_id=RegionOne) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:08.126845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c112e8-72f9-4ca6-b4dc-cde163d4a92a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.128570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c112e8-72f9-4ca6-b4dc-cde163d4a92a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.134538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 451/907] 10.222.0.16 () {56 vars in 1273 bytes} [Wed Jul 28 03:26:08 2021] GET /identity/v3/endpoints?service_id=85a2dd8955bc4674934d160ad901388a&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:08.140711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.150553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ce4dd-604b-4356-af49-ea523f7a9a8e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.155276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70ea84-14fa-4b40-8e9c-0b956b3bca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.156085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ea84-14fa-4b40-8e9c-0b956b3bca7d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.156488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ea84-14fa-4b40-8e9c-0b956b3bca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.156864 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ea84-14fa-4b40-8e9c-0b956b3bca7d admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.157650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70ea84-14fa-4b40-8e9c-0b956b3bca7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.159350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70ea84-14fa-4b40-8e9c-0b956b3bca7d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.169403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 457/908] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:26:08 2021] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:26:08.637085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6501-bf99-4365-8e99-2bbd80035e2b None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.637599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6501-bf99-4365-8e99-2bbd80035e2b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.637672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6501-bf99-4365-8e99-2bbd80035e2b None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.639572 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 452/909] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:08.645496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdf60-ffff-4430-9d0b-87a784d12bb7 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.645913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdf60-ffff-4430-9d0b-87a784d12bb7 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.646128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdf60-ffff-4430-9d0b-87a784d12bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.663614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9bdfdf60-ffff-4430-9d0b-87a784d12bb7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:08.664772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9bdfdf60-ffff-4430-9d0b-87a784d12bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:08.671907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 458/910] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:08 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:08.695700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6501-bf99-4365-8e99-2bbd80035e2b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.706984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6501-bf99-4365-8e99-2bbd80035e2b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.711881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.712668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.712943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.713205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.714125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.715699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.727210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:26:08.728505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 453/911] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 28 03:26:08 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:08.734748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfdf60-ffff-4430-9d0b-87a784d12bb7 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.743615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfdf60-ffff-4430-9d0b-87a784d12bb7 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.747810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.748457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.748734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.749004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.749708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:08.750007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.751580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.756530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 459/912] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:26:08 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:08.762356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.771375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70553fbc-d67b-4fe5-94d2-29aa5742c8f8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.775635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f438f5-bae8-45eb-99fd-d579896d8161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.776327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f438f5-bae8-45eb-99fd-d579896d8161 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.776609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f438f5-bae8-45eb-99fd-d579896d8161 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.776944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f438f5-bae8-45eb-99fd-d579896d8161 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.777645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f438f5-bae8-45eb-99fd-d579896d8161 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:08.778000 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f438f5-bae8-45eb-99fd-d579896d8161 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.779691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f438f5-bae8-45eb-99fd-d579896d8161 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.784554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 454/913] 10.222.0.16 () {56 vars in 1144 bytes} [Wed Jul 28 03:26:08 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:08.790926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:08.799578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c99712-8a81-4f0a-859d-c6b7db3314ec admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:08.804527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0bf87-2acb-4d13-bf94-0496c9c552b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:08.805153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0bf87-2acb-4d13-bf94-0496c9c552b6 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:08.805435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0bf87-2acb-4d13-bf94-0496c9c552b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:08.805708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0bf87-2acb-4d13-bf94-0496c9c552b6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:08.806437 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0bf87-2acb-4d13-bf94-0496c9c552b6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:08.808026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0bf87-2acb-4d13-bf94-0496c9c552b6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:08.823941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 460/914] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:26:08 2021] POST /identity/v3/endpoints => generated 325 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:26:09.616339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085f19c-9932-41d3-ab28-a6df607e1fc5 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:09.616727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085f19c-9932-41d3-ab28-a6df607e1fc5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:09.616923 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085f19c-9932-41d3-ab28-a6df607e1fc5 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:09.618809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 455/915] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:09.624644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6232-2516-4e54-bcd7-29ebb1e5acd7 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:09.624938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6232-2516-4e54-bcd7-29ebb1e5acd7 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:09.625218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6232-2516-4e54-bcd7-29ebb1e5acd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:09.642402 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-038d6232-2516-4e54-bcd7-29ebb1e5acd7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:09.643552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-038d6232-2516-4e54-bcd7-29ebb1e5acd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:09.660585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 461/916] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:09 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:09.685805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085f19c-9932-41d3-ab28-a6df607e1fc5 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:09.697356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085f19c-9932-41d3-ab28-a6df607e1fc5 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:09.701438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:09.702286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:09.702639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:09.702984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:09.703699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:09.705374 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:09.716740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:26:09.718063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 456/917] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:26:09 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:09.725987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6232-2516-4e54-bcd7-29ebb1e5acd7 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:09.734383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6232-2516-4e54-bcd7-29ebb1e5acd7 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:09.738591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:09.739246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:09.739533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:09.739828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:09.740714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:09.741023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:09.742626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:09.747688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 462/918] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:26:09 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:09.753927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:09.763534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e990a43-a1f4-456e-a2ed-4ea33c8219c1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:09.767869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb3689-04e8-4cde-8dfd-0cf543858e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:09.768519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3689-04e8-4cde-8dfd-0cf543858e80 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:09.768801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3689-04e8-4cde-8dfd-0cf543858e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:09.769075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3689-04e8-4cde-8dfd-0cf543858e80 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:09.769776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb3689-04e8-4cde-8dfd-0cf543858e80 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:09.770079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb3689-04e8-4cde-8dfd-0cf543858e80 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:09.772302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb3689-04e8-4cde-8dfd-0cf543858e80 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:09.778386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 457/919] 10.222.0.16 () {56 vars in 1134 bytes} [Wed Jul 28 03:26:09 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:09.783973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:09.795169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278d6d-a0df-4e56-9ac3-c6b0441f78a0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:09.799426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6301e6b-132e-4a2a-a5c2-411cfd156628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:09.800108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301e6b-132e-4a2a-a5c2-411cfd156628 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:09.800392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301e6b-132e-4a2a-a5c2-411cfd156628 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:09.800673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301e6b-132e-4a2a-a5c2-411cfd156628 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:09.801419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6301e6b-132e-4a2a-a5c2-411cfd156628 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:09.803082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6301e6b-132e-4a2a-a5c2-411cfd156628 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:09.822497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 463/920] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:26:09 2021] POST /identity/v3/endpoints => generated 334 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:10.327073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883174-a04c-4192-8b71-134185daa51a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:10.327440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883174-a04c-4192-8b71-134185daa51a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:10.327642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883174-a04c-4192-8b71-134185daa51a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:10.329493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 458/921] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:10.335486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747918-45db-4378-bc77-de1a8640363f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:10.335807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747918-45db-4378-bc77-de1a8640363f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:10.336089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747918-45db-4378-bc77-de1a8640363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:10.354159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9c747918-45db-4378-bc77-de1a8640363f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:10.355302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9c747918-45db-4378-bc77-de1a8640363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:10.372578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 464/922] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:10 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:10.397103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883174-a04c-4192-8b71-134185daa51a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:10.408583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883174-a04c-4192-8b71-134185daa51a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:10.413423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:10.414346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:10.414536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:10.414745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] PATH_INFO: `/v3/services/image` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:10.415394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:10.417008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:10.427604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:26:10.429022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 459/923] 10.222.0.16 () {56 vars in 1127 bytes} [Wed Jul 28 03:26:10 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:10.435378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c747918-45db-4378-bc77-de1a8640363f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:10.443871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c747918-45db-4378-bc77-de1a8640363f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:10.448161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:10.449008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:10.449359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:10.449707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:10.450485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] RBAC: Adding query filter params (name=image) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:10.450862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:10.452599 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:10.459801 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 465/924] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:10 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:10.464569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:10.473594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759461d-c9c6-43cd-ae96-01c50e871205 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:10.478560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5cda6-dfae-4811-971e-992a14ab64ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:10.479207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5cda6-dfae-4811-971e-992a14ab64ac admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:10.479491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5cda6-dfae-4811-971e-992a14ab64ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:10.479798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5cda6-dfae-4811-971e-992a14ab64ac admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:10.480498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5cda6-dfae-4811-971e-992a14ab64ac admin admin] RBAC: Adding query filter params (type=image) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:10.480800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5cda6-dfae-4811-971e-992a14ab64ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:10.482509 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5cda6-dfae-4811-971e-992a14ab64ac admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:10.487689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 460/925] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:10 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:10.493664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:10.502818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925ebb-f34c-4337-8a74-4fad27a5ccbe admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:10.507442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198349b-5574-41d9-91b1-13a51658f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:10.508240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198349b-5574-41d9-91b1-13a51658f59e admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:10.508525 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198349b-5574-41d9-91b1-13a51658f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:10.508799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198349b-5574-41d9-91b1-13a51658f59e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:10.509649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198349b-5574-41d9-91b1-13a51658f59e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:10.511232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198349b-5574-41d9-91b1-13a51658f59e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:10.535742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 466/926] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:26:10 2021] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:26:11.029008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a24f-7115-4a07-bd45-2ad7d8c962ba None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:11.029553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a24f-7115-4a07-bd45-2ad7d8c962ba None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:11.029553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a24f-7115-4a07-bd45-2ad7d8c962ba None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:11.031312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 461/927] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:11.038176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb3452-a921-4181-bd97-f09eb34cec88 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:11.038576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb3452-a921-4181-bd97-f09eb34cec88 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:11.038767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb3452-a921-4181-bd97-f09eb34cec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:11.056282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-bddb3452-a921-4181-bd97-f09eb34cec88 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:11.057420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bddb3452-a921-4181-bd97-f09eb34cec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:11.073278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 467/928] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:11.097365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a24f-7115-4a07-bd45-2ad7d8c962ba None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:11.109914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a24f-7115-4a07-bd45-2ad7d8c962ba None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:11.114095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470240a-35c0-4953-a3ec-6d81dcde15d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:11.115560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470240a-35c0-4953-a3ec-6d81dcde15d2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:11.116055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470240a-35c0-4953-a3ec-6d81dcde15d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:11.116464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470240a-35c0-4953-a3ec-6d81dcde15d2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:11.117654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470240a-35c0-4953-a3ec-6d81dcde15d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:11.121333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470240a-35c0-4953-a3ec-6d81dcde15d2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:11.126487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 462/929] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:11.127624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb3452-a921-4181-bd97-f09eb34cec88 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:11.136531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb3452-a921-4181-bd97-f09eb34cec88 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:11.141985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2a50e-753c-4d2c-af0e-89577e0ddf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:11.142650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a50e-753c-4d2c-af0e-89577e0ddf9b admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:11.142935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a50e-753c-4d2c-af0e-89577e0ddf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:11.143212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a50e-753c-4d2c-af0e-89577e0ddf9b admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:11.143948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2a50e-753c-4d2c-af0e-89577e0ddf9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:11.145857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2a50e-753c-4d2c-af0e-89577e0ddf9b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:11.183095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 468/930] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:26:11 2021] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:12.091340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612f08d-54f7-43cc-b0bf-dcb880213610 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.091907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612f08d-54f7-43cc-b0bf-dcb880213610 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.091907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612f08d-54f7-43cc-b0bf-dcb880213610 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.093799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 463/931] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:12.099864 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12057f32-7eb4-4332-b395-344d88a7e99c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.100285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12057f32-7eb4-4332-b395-344d88a7e99c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.100490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12057f32-7eb4-4332-b395-344d88a7e99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.118216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-12057f32-7eb4-4332-b395-344d88a7e99c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:12.121401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-12057f32-7eb4-4332-b395-344d88a7e99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:12.183335 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 469/932] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:12.208126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612f08d-54f7-43cc-b0bf-dcb880213610 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.219956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612f08d-54f7-43cc-b0bf-dcb880213610 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.224043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ded35-d450-450c-aed5-611cfec0882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.224873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ded35-d450-450c-aed5-611cfec0882e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.225155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ded35-d450-450c-aed5-611cfec0882e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.225430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ded35-d450-450c-aed5-611cfec0882e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.235930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ded35-d450-450c-aed5-611cfec0882e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:12.243621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-ff5ded35-d450-450c-aed5-611cfec0882e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:26:12.245019 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 464/933] 10.222.0.16 () {56 vars in 1142 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:12.251360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12057f32-7eb4-4332-b395-344d88a7e99c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.260479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12057f32-7eb4-4332-b395-344d88a7e99c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.264758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.265422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.265704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.265977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.266753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:12.267059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.268691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.277108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 470/934] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:12.283145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ded35-d450-450c-aed5-611cfec0882e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.293275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ded35-d450-450c-aed5-611cfec0882e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.297542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.298337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.298620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.298896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.309934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.313145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.330210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:26:12.335744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 465/935] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:12.337982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.348826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710e7cb-6aad-4b21-99b2-1489768b35f4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.353975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.354856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.355317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.355821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.356788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:12.357283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.359048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.372272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 471/936] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:12.378346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.387956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f357d-4bb5-4d52-963d-ef77e0ca8746 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.392476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.393411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.393695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.393971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.402298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.404418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.419673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:26:12.421086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 466/937] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:12.427278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.437216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919e22-9bdb-4978-a4ad-ffdd615727ab admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.441604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.442361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.442712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.443072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.444014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:12.444389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.446315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.470836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 472/938] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:12.471818 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.481381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11a9bf-2767-4d79-bf9e-31ecbb4ea644 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.485702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce52b-d364-437d-87e4-56a0094fdd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.486338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce52b-d364-437d-87e4-56a0094fdd0a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.486618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce52b-d364-437d-87e4-56a0094fdd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.486887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce52b-d364-437d-87e4-56a0094fdd0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.495040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ce52b-d364-437d-87e4-56a0094fdd0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.496811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ce52b-d364-437d-87e4-56a0094fdd0a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.505304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 467/939] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:26:12.511948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.521089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cf2a1-8d77-421b-93d3-d0e51c9ec9b6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.525403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.526252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.526602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.526946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.538871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.540772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.557664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:26:12.559029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 473/940] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:12.565050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce52b-d364-437d-87e4-56a0094fdd0a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.573929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce52b-d364-437d-87e4-56a0094fdd0a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.578271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.578998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.579339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.579680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.580488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:12.580858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.582525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.599095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 468/941] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:12.600502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.609510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314a6d-0faf-47aa-8b29-7219cab264c1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.613788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.614562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.614934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.615376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.622062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.624034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.636826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:26:12.638136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 474/942] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:12.644457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.653954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a291b-d250-47d2-a1d4-4141b962a423 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.658212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c0146-e91e-4773-82cb-3c6895dfa317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.658859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c0146-e91e-4773-82cb-3c6895dfa317 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.659140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c0146-e91e-4773-82cb-3c6895dfa317 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.659413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c0146-e91e-4773-82cb-3c6895dfa317 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.660218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c0146-e91e-4773-82cb-3c6895dfa317 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:12.660529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c0146-e91e-4773-82cb-3c6895dfa317 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.662960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c0146-e91e-4773-82cb-3c6895dfa317 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.681543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 469/943] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:12.682817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.693325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c4aca-8e12-485a-bdeb-040856828ec8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.697888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129b7d1-f30e-4947-abfa-99610cb9cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.698554 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129b7d1-f30e-4947-abfa-99610cb9cc09 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.698833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129b7d1-f30e-4947-abfa-99610cb9cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.699108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129b7d1-f30e-4947-abfa-99610cb9cc09 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.699986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129b7d1-f30e-4947-abfa-99610cb9cc09 admin admin] RBAC: Adding query filter params (role.id=03ae1df3911a446f8243e54b57bfb293, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=dbe34d9bb0994e7f80044be0a373ed5e) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:12.700297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129b7d1-f30e-4947-abfa-99610cb9cc09 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.702179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129b7d1-f30e-4947-abfa-99610cb9cc09 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.708461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 475/944] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/role_assignments?user.id=dbe34d9bb0994e7f80044be0a373ed5e&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=03ae1df3911a446f8243e54b57bfb293 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:12.745814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0a45-7119-4265-9780-f6a598875de3 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.746151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0a45-7119-4265-9780-f6a598875de3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.746369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0a45-7119-4265-9780-f6a598875de3 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.748235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 470/945] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:12.754684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579860c-8103-48ac-998d-13d3d93f2701 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.754986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579860c-8103-48ac-998d-13d3d93f2701 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.755241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579860c-8103-48ac-998d-13d3d93f2701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.774204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-5579860c-8103-48ac-998d-13d3d93f2701 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:12.775392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5579860c-8103-48ac-998d-13d3d93f2701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:12.782698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 476/946] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:12.812109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd0a45-7119-4265-9780-f6a598875de3 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.824289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd0a45-7119-4265-9780-f6a598875de3 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.828507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130d9b-e787-4522-a24d-ea1ee6b17598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.829163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130d9b-e787-4522-a24d-ea1ee6b17598 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.829437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130d9b-e787-4522-a24d-ea1ee6b17598 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.829711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130d9b-e787-4522-a24d-ea1ee6b17598 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.839030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130d9b-e787-4522-a24d-ea1ee6b17598 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.840834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130d9b-e787-4522-a24d-ea1ee6b17598 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.851088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 471/947] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:12.857516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579860c-8103-48ac-998d-13d3d93f2701 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:12.866395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579860c-8103-48ac-998d-13d3d93f2701 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:12.870862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b89135-94f8-4d1c-ae9f-b377d238f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:12.871785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89135-94f8-4d1c-ae9f-b377d238f550 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:12.872075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89135-94f8-4d1c-ae9f-b377d238f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:12.872357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89135-94f8-4d1c-ae9f-b377d238f550 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:12.873489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b89135-94f8-4d1c-ae9f-b377d238f550 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:12.875191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b89135-94f8-4d1c-ae9f-b377d238f550 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:12.876780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 477/948] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:13.400804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395b914-221f-441e-930b-73f18c66de21 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:13.401298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395b914-221f-441e-930b-73f18c66de21 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:13.401298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395b914-221f-441e-930b-73f18c66de21 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:13.403005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 472/949] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:13.408959 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5918-a759-4792-91eb-4cd3cde6d859 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:13.409376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5918-a759-4792-91eb-4cd3cde6d859 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:13.409510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5918-a759-4792-91eb-4cd3cde6d859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:13.426842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-bb7b5918-a759-4792-91eb-4cd3cde6d859 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:13.428132 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bb7b5918-a759-4792-91eb-4cd3cde6d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:13.435123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 478/950] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:13.460738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395b914-221f-441e-930b-73f18c66de21 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:13.472170 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395b914-221f-441e-930b-73f18c66de21 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:13.476899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eef40-7870-47b9-8a8d-02639c21c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:13.477670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eef40-7870-47b9-8a8d-02639c21c5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:13.477948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eef40-7870-47b9-8a8d-02639c21c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:13.478218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eef40-7870-47b9-8a8d-02639c21c5b3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:13.479319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eef40-7870-47b9-8a8d-02639c21c5b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:13.481032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eef40-7870-47b9-8a8d-02639c21c5b3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:13.482553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 473/951] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:13.488927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b5918-a759-4792-91eb-4cd3cde6d859 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:13.497440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b5918-a759-4792-91eb-4cd3cde6d859 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:13.501703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dbf06-57ae-48ff-8f87-db9c0999d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:13.502357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dbf06-57ae-48ff-8f87-db9c0999d61a admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:13.502637 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dbf06-57ae-48ff-8f87-db9c0999d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:13.502908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dbf06-57ae-48ff-8f87-db9c0999d61a admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:13.503616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dbf06-57ae-48ff-8f87-db9c0999d61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:13.505676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dbf06-57ae-48ff-8f87-db9c0999d61a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:13.535735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 479/952] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:26:13 2021] POST /identity/v3/users => generated 285 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:14.844859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef88e-641a-42ad-97b9-3fc9653ebf5a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:14.845399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef88e-641a-42ad-97b9-3fc9653ebf5a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:14.845399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef88e-641a-42ad-97b9-3fc9653ebf5a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:14.847136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 474/953] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:14.853583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac933a0-8660-4dc0-b537-c6434865c4fb None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:14.853999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac933a0-8660-4dc0-b537-c6434865c4fb None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:14.854265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac933a0-8660-4dc0-b537-c6434865c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:14.872339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6ac933a0-8660-4dc0-b537-c6434865c4fb None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:14.873483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6ac933a0-8660-4dc0-b537-c6434865c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:14.880722 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 480/954] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:14.904191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ef88e-641a-42ad-97b9-3fc9653ebf5a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:14.916197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ef88e-641a-42ad-97b9-3fc9653ebf5a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:14.920225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47946-751c-41b9-b8ee-5068912b5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:14.921003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47946-751c-41b9-b8ee-5068912b5d96 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:14.921281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47946-751c-41b9-b8ee-5068912b5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:14.921551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47946-751c-41b9-b8ee-5068912b5d96 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:14.931281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f47946-751c-41b9-b8ee-5068912b5d96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:14.938295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-49f47946-751c-41b9-b8ee-5068912b5d96 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:26:14.939413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 475/955] 10.222.0.16 () {56 vars in 1142 bytes} [Wed Jul 28 03:26:14 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:14.945627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac933a0-8660-4dc0-b537-c6434865c4fb None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:14.953926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac933a0-8660-4dc0-b537-c6434865c4fb None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:14.958199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:14.959430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:14.959738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:14.960019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:14.960767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:14.961069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:14.962646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:14.975731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 481/956] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 28 03:26:14 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:14.977434 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47946-751c-41b9-b8ee-5068912b5d96 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:14.986508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47946-751c-41b9-b8ee-5068912b5d96 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:14.990853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:14.991610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:14.991913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:14.992180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.001915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.003750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.019578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:26:15.020748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 476/957] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:15.027756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.037131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df482e9-c96d-48e0-ba5e-4c609ff3cb67 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.041383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.042028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.042308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.042582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.043295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:15.043597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.045204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.057771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 482/958] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:15.063908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.073307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b03fd-0e9d-4f99-b076-1a087ea1298e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.077461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.078219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.078493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.078760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.085706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.087685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.100995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:26:15.102043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 477/959] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/users/nova => generated 82 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:15.108392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.118217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838996a3-4c55-4258-9e9a-35e342f0c838 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.122645 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.123644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.123644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.123876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.124717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:15.125027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.126878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.144867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 483/960] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:15.151255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.160080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c269-d7eb-4d38-9b60-fe80272cbda6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.164297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.165077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.165354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.165628 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.175528 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.178013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.194732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:26:15.195893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 478/961] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:15.202251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.211889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7031ca-6fcd-4104-b0cd-d6a909991d11 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.216448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.217165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.217516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.217857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.218642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:15.219012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.220729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.231788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 484/962] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:15.237960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.247562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f5b3f-f04d-44a6-8169-7b549fa38f92 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.251677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.252484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.252758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.253025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.260146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.262085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.274504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:26:15.275632 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 479/963] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:15.282141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.291825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee99a1-3558-4fdb-8792-283bf7a1c5a0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.296077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064382b-417c-4506-8a66-ead74141180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.296720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064382b-417c-4506-8a66-ead74141180e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.297002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064382b-417c-4506-8a66-ead74141180e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.297277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064382b-417c-4506-8a66-ead74141180e admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.298084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064382b-417c-4506-8a66-ead74141180e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:15.298392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064382b-417c-4506-8a66-ead74141180e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.300250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064382b-417c-4506-8a66-ead74141180e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.312642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 485/964] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:15.319557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.329117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7325a01-9984-4fd3-a265-fedcc57b0f13 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.333321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d64a00-7822-458f-aaa4-359e95d53b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.334695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64a00-7822-458f-aaa4-359e95d53b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.334975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64a00-7822-458f-aaa4-359e95d53b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.335251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64a00-7822-458f-aaa4-359e95d53b8b admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/dbe34d9bb0994e7f80044be0a373ed5e/roles/03ae1df3911a446f8243e54b57bfb293` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.337323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d64a00-7822-458f-aaa4-359e95d53b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=dbe34d9bb0994e7f80044be0a373ed5e, role_id=03ae1df3911a446f8243e54b57bfb293)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.340242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d64a00-7822-458f-aaa4-359e95d53b8b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.354700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 480/965] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:26:15 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/dbe34d9bb0994e7f80044be0a373ed5e/roles/03ae1df3911a446f8243e54b57bfb293 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:26:15.727970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6baa48-3242-4501-815c-9bc420e5eda4 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.728182 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6baa48-3242-4501-815c-9bc420e5eda4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.728462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6baa48-3242-4501-815c-9bc420e5eda4 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.730258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 486/966] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:15.736268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea01a3-30f1-4a85-908d-d6a269ff4a65 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.736557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea01a3-30f1-4a85-908d-d6a269ff4a65 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.736833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea01a3-30f1-4a85-908d-d6a269ff4a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.753710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-40ea01a3-30f1-4a85-908d-d6a269ff4a65 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:15.754847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-40ea01a3-30f1-4a85-908d-d6a269ff4a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:15.808909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 481/967] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:15.833159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6baa48-3242-4501-815c-9bc420e5eda4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.845463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6baa48-3242-4501-815c-9bc420e5eda4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.850262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0d263-1940-4973-9f54-bf23f9d859fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.851110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0d263-1940-4973-9f54-bf23f9d859fc admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.851676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0d263-1940-4973-9f54-bf23f9d859fc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.851676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0d263-1940-4973-9f54-bf23f9d859fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.861429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0d263-1940-4973-9f54-bf23f9d859fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:15.868732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-3bd0d263-1940-4973-9f54-bf23f9d859fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:15.869890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 487/968] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:15.876263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea01a3-30f1-4a85-908d-d6a269ff4a65 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.884746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea01a3-30f1-4a85-908d-d6a269ff4a65 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.889025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.889680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.889962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.890242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.890986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:15.891292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.892937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.901606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 482/969] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:15.907764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0d263-1940-4973-9f54-bf23f9d859fc admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.917856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0d263-1940-4973-9f54-bf23f9d859fc admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.922069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b901-9662-415b-a6a4-065d87b43ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.922904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b901-9662-415b-a6a4-065d87b43ade admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.923185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b901-9662-415b-a6a4-065d87b43ade admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.923467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b901-9662-415b-a6a4-065d87b43ade admin admin] PATH_INFO: `/v3/users/becce1fb25a14d4d8b4c004b7bb49281` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.936340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b901-9662-415b-a6a4-065d87b43ade admin admin] RBAC: Authorizing `identity:get_user(user_id=becce1fb25a14d4d8b4c004b7bb49281)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.938479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b901-9662-415b-a6a4-065d87b43ade admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.940092 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 488/970] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/users/becce1fb25a14d4d8b4c004b7bb49281 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:15.946516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.955304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92e8ca-9497-4276-a82d-22c18e927d59 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.960227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8570af-a258-4b83-a171-17932ff2d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.960860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8570af-a258-4b83-a171-17932ff2d725 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:15.961151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8570af-a258-4b83-a171-17932ff2d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:15.961430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8570af-a258-4b83-a171-17932ff2d725 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:15.968941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8570af-a258-4b83-a171-17932ff2d725 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:15.970674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8570af-a258-4b83-a171-17932ff2d725 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:15.979542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 483/971] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:15.985638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b901-9662-415b-a6a4-065d87b43ade admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:15.994705 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b901-9662-415b-a6a4-065d87b43ade admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:15.998957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6ddae-fd40-4bd1-a4a4-00baf0f35b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:15.999828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6ddae-fd40-4bd1-a4a4-00baf0f35b16 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:16.000111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6ddae-fd40-4bd1-a4a4-00baf0f35b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:16.000386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6ddae-fd40-4bd1-a4a4-00baf0f35b16 admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:16.001509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6ddae-fd40-4bd1-a4a4-00baf0f35b16 admin admin] RBAC: Authorizing `identity:get_project(project_id=36c308cc13dd4268b9f547b35c08e22a)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:16.003545 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6ddae-fd40-4bd1-a4a4-00baf0f35b16 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:16.005200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 489/972] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:15 2021] GET /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:16.012411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8570af-a258-4b83-a171-17932ff2d725 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:16.020625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8570af-a258-4b83-a171-17932ff2d725 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:16.025618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e312e69-65a1-419c-b5f0-7ecae3cd66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:16.026317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e312e69-65a1-419c-b5f0-7ecae3cd66e5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:16.026718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e312e69-65a1-419c-b5f0-7ecae3cd66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:16.027100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e312e69-65a1-419c-b5f0-7ecae3cd66e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:16.028272 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e312e69-65a1-419c-b5f0-7ecae3cd66e5 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=36c308cc13dd4268b9f547b35c08e22a, user.id=becce1fb25a14d4d8b4c004b7bb49281) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:16.028712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e312e69-65a1-419c-b5f0-7ecae3cd66e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:16.030643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e312e69-65a1-419c-b5f0-7ecae3cd66e5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:16.036051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 484/973] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:16 2021] GET /identity/v3/role_assignments?user.id=becce1fb25a14d4d8b4c004b7bb49281&scope.project.id=36c308cc13dd4268b9f547b35c08e22a&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:17.474953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864f6c8-072f-424b-b772-48d6151b1d12 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.475696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864f6c8-072f-424b-b772-48d6151b1d12 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.475696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864f6c8-072f-424b-b772-48d6151b1d12 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.477191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 490/974] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:17.483207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304c740-d89b-46c6-aee9-4814a1558895 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.483625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304c740-d89b-46c6-aee9-4814a1558895 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.483786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304c740-d89b-46c6-aee9-4814a1558895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.501701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0304c740-d89b-46c6-aee9-4814a1558895 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:17.502827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0304c740-d89b-46c6-aee9-4814a1558895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:17.510427 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 485/975] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:17.534537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864f6c8-072f-424b-b772-48d6151b1d12 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.545889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864f6c8-072f-424b-b772-48d6151b1d12 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.549936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619caff3-11cd-4d9c-8d65-1a7b0bce553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.550727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619caff3-11cd-4d9c-8d65-1a7b0bce553e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.551006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619caff3-11cd-4d9c-8d65-1a7b0bce553e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.551278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619caff3-11cd-4d9c-8d65-1a7b0bce553e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.561316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619caff3-11cd-4d9c-8d65-1a7b0bce553e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:17.569202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-619caff3-11cd-4d9c-8d65-1a7b0bce553e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:26:17.570373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 491/976] 10.222.0.16 () {56 vars in 1142 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:17.576751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304c740-d89b-46c6-aee9-4814a1558895 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.585475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304c740-d89b-46c6-aee9-4814a1558895 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.589929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.590575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.590850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.591119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.591879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:17.592177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.593760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.601578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 486/977] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:17.607575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619caff3-11cd-4d9c-8d65-1a7b0bce553e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.617643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619caff3-11cd-4d9c-8d65-1a7b0bce553e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.621944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.622716 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.622998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.623273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.633805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.635635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.651543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:26:17.652725 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 492/978] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:17.658856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.668089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86d2c7-7ae7-451f-a7f7-ce1b778145ef admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.672362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.673082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.673443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.673778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.674555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:17.674919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.676587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.688596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 487/979] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:17.695415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.704349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722b9b-6201-4808-9df5-234b3b37b670 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.709597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.710371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.710646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.710916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.718169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.720215 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.733800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:26:17.734885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 493/980] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:17.741276 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.750349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4187-6455-4304-8d48-14c7ae08bbe9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.754707 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.755974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.756260 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.756534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.757370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:17.757673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.759498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.776672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 488/981] 10.222.0.16 () {56 vars in 1155 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:17.782943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.792129 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf234d3-775f-41e6-8c44-601df8d1068f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.796381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa3755-a480-482a-b21c-b20925c2e8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.797015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3755-a480-482a-b21c-b20925c2e8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.797292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3755-a480-482a-b21c-b20925c2e8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.797562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3755-a480-482a-b21c-b20925c2e8a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.804970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa3755-a480-482a-b21c-b20925c2e8a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.806714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa3755-a480-482a-b21c-b20925c2e8a7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.814907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 494/982] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:26:17.821957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.830799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4780ac-0572-4cf0-b913-2dde2b3324be admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.835634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.836447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.836728 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.837001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.846974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.848822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.865179 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:26:17.866458 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 489/983] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:17.872772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa3755-a480-482a-b21c-b20925c2e8a7 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.882169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa3755-a480-482a-b21c-b20925c2e8a7 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.886553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.887201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.887481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.887788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.888508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:17.888811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.890387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.901705 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 495/984] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:17.907929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.917020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4c93-773d-45a3-885a-71d6baa7d574 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.921319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.922094 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.922371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.922640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.929718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.931649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.944541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:26:17.945670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 490/985] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:17.952045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.961078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c716-34ff-4f2e-a2c9-55c1b57bc41a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:17.965521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093e5b5-ab46-43d4-a37a-583322c68a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:17.966162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e5b5-ab46-43d4-a37a-583322c68a39 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:17.966441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e5b5-ab46-43d4-a37a-583322c68a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:17.966713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e5b5-ab46-43d4-a37a-583322c68a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:17.967489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093e5b5-ab46-43d4-a37a-583322c68a39 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:17.967820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093e5b5-ab46-43d4-a37a-583322c68a39 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:17.969656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093e5b5-ab46-43d4-a37a-583322c68a39 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:17.982280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 496/986] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:17.988820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:17.998998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3e81-d646-4d68-85a8-b2d96d1a7bc9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:18.003316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59fcc3-ec9f-4c71-a6d1-9ddd02ef3d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:18.003977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fcc3-ec9f-4c71-a6d1-9ddd02ef3d7e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:18.004259 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fcc3-ec9f-4c71-a6d1-9ddd02ef3d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:18.004533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fcc3-ec9f-4c71-a6d1-9ddd02ef3d7e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:18.005938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59fcc3-ec9f-4c71-a6d1-9ddd02ef3d7e admin admin] RBAC: Adding query filter params (role.id=03ae1df3911a446f8243e54b57bfb293, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=dbe34d9bb0994e7f80044be0a373ed5e) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:18.006277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59fcc3-ec9f-4c71-a6d1-9ddd02ef3d7e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:18.008318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59fcc3-ec9f-4c71-a6d1-9ddd02ef3d7e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:18.014001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 491/987] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:17 2021] GET /identity/v3/role_assignments?user.id=dbe34d9bb0994e7f80044be0a373ed5e&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=03ae1df3911a446f8243e54b57bfb293 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:18.167909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ba80-e051-496a-905b-f6daec856246 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:18.168209 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ba80-e051-496a-905b-f6daec856246 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:18.168481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ba80-e051-496a-905b-f6daec856246 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:18.170275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 497/988] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:26:18.176617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54376b78-4d26-41cf-9cba-bce419a30a2b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:18.176998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54376b78-4d26-41cf-9cba-bce419a30a2b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:18.177320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54376b78-4d26-41cf-9cba-bce419a30a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:18.195372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-54376b78-4d26-41cf-9cba-bce419a30a2b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:18.196624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-54376b78-4d26-41cf-9cba-bce419a30a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:18.204118 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 492/989] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:18.229519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ba80-e051-496a-905b-f6daec856246 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:18.241777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ba80-e051-496a-905b-f6daec856246 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:18.245919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab5b4-1bed-4125-92cd-e1182720109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:18.246712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab5b4-1bed-4125-92cd-e1182720109e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:18.246991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab5b4-1bed-4125-92cd-e1182720109e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:18.247266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab5b4-1bed-4125-92cd-e1182720109e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:18.258420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eab5b4-1bed-4125-92cd-e1182720109e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:18.265144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-a8eab5b4-1bed-4125-92cd-e1182720109e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:18.266347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 498/990] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:18.274190 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54376b78-4d26-41cf-9cba-bce419a30a2b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:18.284816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54376b78-4d26-41cf-9cba-bce419a30a2b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:18.289307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:18.289973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:18.290258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:18.290531 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:18.291273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:18.291574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:18.293248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:18.301824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 493/991] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:18.308579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab5b4-1bed-4125-92cd-e1182720109e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:18.317735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab5b4-1bed-4125-92cd-e1182720109e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:18.322585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9917ae-0178-4da4-afc3-f9922e7abb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:18.323446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9917ae-0178-4da4-afc3-f9922e7abb59 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:18.324211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9917ae-0178-4da4-afc3-f9922e7abb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:18.324211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9917ae-0178-4da4-afc3-f9922e7abb59 admin admin] PATH_INFO: `/v3/users/becce1fb25a14d4d8b4c004b7bb49281` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:18.325291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9917ae-0178-4da4-afc3-f9922e7abb59 admin admin] RBAC: Authorizing `identity:get_user(user_id=becce1fb25a14d4d8b4c004b7bb49281)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:18.327451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9917ae-0178-4da4-afc3-f9922e7abb59 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:18.329060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 499/992] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:18 2021] GET /identity/v3/users/becce1fb25a14d4d8b4c004b7bb49281 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:18.336218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:18.345617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a4f03-3004-4010-8b2d-b07301885faa admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:18.350356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188ba9-8058-4561-b88b-d282dcad0fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:18.351192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188ba9-8058-4561-b88b-d282dcad0fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:18.351479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188ba9-8058-4561-b88b-d282dcad0fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:18.351778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188ba9-8058-4561-b88b-d282dcad0fd0 admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:18.352909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188ba9-8058-4561-b88b-d282dcad0fd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=36c308cc13dd4268b9f547b35c08e22a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:18.354961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188ba9-8058-4561-b88b-d282dcad0fd0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:18.356596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 494/993] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:18 2021] GET /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:18.363148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9917ae-0178-4da4-afc3-f9922e7abb59 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:18.373079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9917ae-0178-4da4-afc3-f9922e7abb59 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:18.377684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a535a-3b79-4961-a944-d837a0e0f88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:18.378561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a535a-3b79-4961-a944-d837a0e0f88e admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:18.378842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a535a-3b79-4961-a944-d837a0e0f88e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:18.379118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a535a-3b79-4961-a944-d837a0e0f88e admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a/users/becce1fb25a14d4d8b4c004b7bb49281/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:18.381521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a535a-3b79-4961-a944-d837a0e0f88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c308cc13dd4268b9f547b35c08e22a, user_id=becce1fb25a14d4d8b4c004b7bb49281, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:18.384201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a535a-3b79-4961-a944-d837a0e0f88e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:18.398027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 500/994] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:26:18 2021] PUT /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a/users/becce1fb25a14d4d8b4c004b7bb49281/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:26:20.512357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df44214-4f7a-4553-90a0-399ac517c84b None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:20.512870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df44214-4f7a-4553-90a0-399ac517c84b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:20.512870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df44214-4f7a-4553-90a0-399ac517c84b None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:20.514582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 495/995] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:20.520444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa21f-5376-4c6b-9919-b5ab5504ba10 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:20.520860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa21f-5376-4c6b-9919-b5ab5504ba10 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:20.521601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa21f-5376-4c6b-9919-b5ab5504ba10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:20.538039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c22aa21f-5376-4c6b-9919-b5ab5504ba10 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:20.539176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c22aa21f-5376-4c6b-9919-b5ab5504ba10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:20.592931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 501/996] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:20.617143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df44214-4f7a-4553-90a0-399ac517c84b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:20.628410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df44214-4f7a-4553-90a0-399ac517c84b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:20.633074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e015b0-628c-47bc-8b26-341fa827ce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:20.633847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e015b0-628c-47bc-8b26-341fa827ce7c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:20.634132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e015b0-628c-47bc-8b26-341fa827ce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:20.634408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e015b0-628c-47bc-8b26-341fa827ce7c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:20.644501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e015b0-628c-47bc-8b26-341fa827ce7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:20.652282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-31e015b0-628c-47bc-8b26-341fa827ce7c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:20.653414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 496/997] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:20.659788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22aa21f-5376-4c6b-9919-b5ab5504ba10 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:20.667840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22aa21f-5376-4c6b-9919-b5ab5504ba10 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:20.672050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:20.672693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:20.672971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:20.673243 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:20.673976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:20.674275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:20.675889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:20.683901 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 502/998] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:20.689896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e015b0-628c-47bc-8b26-341fa827ce7c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:20.699188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e015b0-628c-47bc-8b26-341fa827ce7c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:20.703376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c43f18-4782-4847-be7c-153cb39b9fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:20.704239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43f18-4782-4847-be7c-153cb39b9fea admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:20.704521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43f18-4782-4847-be7c-153cb39b9fea admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:20.704797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43f18-4782-4847-be7c-153cb39b9fea admin admin] PATH_INFO: `/v3/users/becce1fb25a14d4d8b4c004b7bb49281` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:20.705929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c43f18-4782-4847-be7c-153cb39b9fea admin admin] RBAC: Authorizing `identity:get_user(user_id=becce1fb25a14d4d8b4c004b7bb49281)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:20.708085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c43f18-4782-4847-be7c-153cb39b9fea admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:20.709777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 497/999] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:20 2021] GET /identity/v3/users/becce1fb25a14d4d8b4c004b7bb49281 => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:20.716017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:20.725378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbda7f1-e9d3-42ea-bd6b-a36b503c8477 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:20.729618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce9a41-d3e7-4284-acda-0bb37996cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:20.730233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce9a41-d3e7-4284-acda-0bb37996cedb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:20.730512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce9a41-d3e7-4284-acda-0bb37996cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:20.730783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce9a41-d3e7-4284-acda-0bb37996cedb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:20.737886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce9a41-d3e7-4284-acda-0bb37996cedb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:20.739677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce9a41-d3e7-4284-acda-0bb37996cedb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:20.748268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 503/1000] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:20 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:20.754195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c43f18-4782-4847-be7c-153cb39b9fea admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:20.763463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c43f18-4782-4847-be7c-153cb39b9fea admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:20.767630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cbb76-57b4-4d8a-a468-029de6fe2e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:20.768461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cbb76-57b4-4d8a-a468-029de6fe2e8a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:20.768742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cbb76-57b4-4d8a-a468-029de6fe2e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:20.769014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cbb76-57b4-4d8a-a468-029de6fe2e8a admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:20.770120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cbb76-57b4-4d8a-a468-029de6fe2e8a admin admin] RBAC: Authorizing `identity:get_project(project_id=36c308cc13dd4268b9f547b35c08e22a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:20.772763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cbb76-57b4-4d8a-a468-029de6fe2e8a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:20.774316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 498/1001] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:20 2021] GET /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:20.780429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce9a41-d3e7-4284-acda-0bb37996cedb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:20.788273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce9a41-d3e7-4284-acda-0bb37996cedb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:20.792516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9999a-ff1b-4b20-aed9-cc70f0f05841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:20.793127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9999a-ff1b-4b20-aed9-cc70f0f05841 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:20.793408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9999a-ff1b-4b20-aed9-cc70f0f05841 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:20.793681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9999a-ff1b-4b20-aed9-cc70f0f05841 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:20.794482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9999a-ff1b-4b20-aed9-cc70f0f05841 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=36c308cc13dd4268b9f547b35c08e22a, user.id=becce1fb25a14d4d8b4c004b7bb49281) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:20.794786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9999a-ff1b-4b20-aed9-cc70f0f05841 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:20.796616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9999a-ff1b-4b20-aed9-cc70f0f05841 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:20.802169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 504/1002] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:20 2021] GET /identity/v3/role_assignments?user.id=becce1fb25a14d4d8b4c004b7bb49281&scope.project.id=36c308cc13dd4268b9f547b35c08e22a&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:22.941008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604b1c-ec5b-4926-a4eb-44d85f907540 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:22.941538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604b1c-ec5b-4926-a4eb-44d85f907540 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:22.941538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604b1c-ec5b-4926-a4eb-44d85f907540 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:22.943861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 499/1003] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:22.949782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfe538-2019-4d9d-9cc6-75cc75624ce4 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:22.950186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfe538-2019-4d9d-9cc6-75cc75624ce4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:22.950340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfe538-2019-4d9d-9cc6-75cc75624ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:22.968171 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-46dfe538-2019-4d9d-9cc6-75cc75624ce4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:22.969324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-46dfe538-2019-4d9d-9cc6-75cc75624ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:22.976582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 505/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:23.001186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69604b1c-ec5b-4926-a4eb-44d85f907540 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:23.012935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69604b1c-ec5b-4926-a4eb-44d85f907540 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:23.016929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e465b-0c38-4f3b-a611-6337cad41247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:23.017690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e465b-0c38-4f3b-a611-6337cad41247 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:23.017966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e465b-0c38-4f3b-a611-6337cad41247 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:23.018235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e465b-0c38-4f3b-a611-6337cad41247 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:23.019322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e465b-0c38-4f3b-a611-6337cad41247 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:23.021621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e465b-0c38-4f3b-a611-6337cad41247 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:23.023104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 500/1005] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:23.029011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfe538-2019-4d9d-9cc6-75cc75624ce4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:23.037167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfe538-2019-4d9d-9cc6-75cc75624ce4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:23.041401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cdbff-83bc-4ad0-9f1e-3539426a4bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:23.042077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cdbff-83bc-4ad0-9f1e-3539426a4bbc admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:23.042359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cdbff-83bc-4ad0-9f1e-3539426a4bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:23.042631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cdbff-83bc-4ad0-9f1e-3539426a4bbc admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:23.043327 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cdbff-83bc-4ad0-9f1e-3539426a4bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:23.045249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cdbff-83bc-4ad0-9f1e-3539426a4bbc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:23.064292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 506/1006] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:26:23 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:26:25.270634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70069-8d4a-4ea1-9712-9020cdfa6fc2 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:25.271300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70069-8d4a-4ea1-9712-9020cdfa6fc2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:25.271300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70069-8d4a-4ea1-9712-9020cdfa6fc2 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:25.273666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 501/1007] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:25.279727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad716-30d1-435d-947e-88cff497531e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:25.280123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad716-30d1-435d-947e-88cff497531e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:25.280283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad716-30d1-435d-947e-88cff497531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:25.297204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-786ad716-30d1-435d-947e-88cff497531e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:25.298380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-786ad716-30d1-435d-947e-88cff497531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:25.305493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 507/1008] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:25.330242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e70069-8d4a-4ea1-9712-9020cdfa6fc2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:25.342498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e70069-8d4a-4ea1-9712-9020cdfa6fc2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:25.346548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:25.347373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:25.347655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:25.347958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] PATH_INFO: `/v3/roles/86c69e4b7605423ebcc1c4d6bc21c052` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:25.349864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] RBAC: Authorizing `identity:get_role(role_id=86c69e4b7605423ebcc1c4d6bc21c052)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:25.350859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:26:25.350859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:26:25.350859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:26:25.351753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:25.353040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 502/1009] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:25 2021] GET /identity/v3/roles/86c69e4b7605423ebcc1c4d6bc21c052 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:25.359189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ad716-30d1-435d-947e-88cff497531e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:25.368031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ad716-30d1-435d-947e-88cff497531e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:25.372258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd356-90c5-4935-8775-13448211aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:25.373150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd356-90c5-4935-8775-13448211aa6e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:25.373383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd356-90c5-4935-8775-13448211aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:25.373657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd356-90c5-4935-8775-13448211aa6e admin admin] PATH_INFO: `/v3/users/ce945381c53f4dbd900446045487f458` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:25.386456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dd356-90c5-4935-8775-13448211aa6e admin admin] RBAC: Authorizing `identity:get_user(user_id=ce945381c53f4dbd900446045487f458)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:25.388623 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dd356-90c5-4935-8775-13448211aa6e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:25.390158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 508/1010] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:25 2021] GET /identity/v3/users/ce945381c53f4dbd900446045487f458 => generated 286 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:25.397129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:25.405720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f80f94-4029-4aaa-b8f1-3aa36c034b92 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:25.409888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02bf93-cd44-46ed-b090-bb4a3a0f67a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:25.410503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bf93-cd44-46ed-b090-bb4a3a0f67a4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:25.410783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bf93-cd44-46ed-b090-bb4a3a0f67a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:25.411055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bf93-cd44-46ed-b090-bb4a3a0f67a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:25.419095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02bf93-cd44-46ed-b090-bb4a3a0f67a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:25.420807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02bf93-cd44-46ed-b090-bb4a3a0f67a4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:25.429017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 503/1011] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:25 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:25.435161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd356-90c5-4935-8775-13448211aa6e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:25.444032 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd356-90c5-4935-8775-13448211aa6e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:25.448256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafea625-4674-4d65-8e77-09501f3cc119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:25.449085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea625-4674-4d65-8e77-09501f3cc119 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:25.449364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea625-4674-4d65-8e77-09501f3cc119 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:25.449639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea625-4674-4d65-8e77-09501f3cc119 admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:25.450767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafea625-4674-4d65-8e77-09501f3cc119 admin admin] RBAC: Authorizing `identity:get_project(project_id=36c308cc13dd4268b9f547b35c08e22a)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:25.452818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafea625-4674-4d65-8e77-09501f3cc119 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:25.454507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 509/1012] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:25 2021] GET /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:25.461141 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02bf93-cd44-46ed-b090-bb4a3a0f67a4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:25.469109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02bf93-cd44-46ed-b090-bb4a3a0f67a4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:25.473323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d466fa-0953-477a-9e64-9e15e55838d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:25.474921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d466fa-0953-477a-9e64-9e15e55838d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:25.475224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d466fa-0953-477a-9e64-9e15e55838d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:25.475499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d466fa-0953-477a-9e64-9e15e55838d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:25.476331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d466fa-0953-477a-9e64-9e15e55838d4 admin admin] RBAC: Adding query filter params (role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=36c308cc13dd4268b9f547b35c08e22a, user.id=ce945381c53f4dbd900446045487f458) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:25.476637 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d466fa-0953-477a-9e64-9e15e55838d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:25.478433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d466fa-0953-477a-9e64-9e15e55838d4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:25.483438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 504/1013] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:25 2021] GET /identity/v3/role_assignments?user.id=ce945381c53f4dbd900446045487f458&scope.project.id=36c308cc13dd4268b9f547b35c08e22a&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:27.573631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b7d8-043c-40fe-9a3a-03e3464794e9 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:27.574143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b7d8-043c-40fe-9a3a-03e3464794e9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:27.574143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b7d8-043c-40fe-9a3a-03e3464794e9 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:27.575867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 510/1014] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:27.581813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1730b-644a-4c6a-911e-5b07c83b62cc None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:27.582186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1730b-644a-4c6a-911e-5b07c83b62cc None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:27.582374 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1730b-644a-4c6a-911e-5b07c83b62cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:27.600103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b3d1730b-644a-4c6a-911e-5b07c83b62cc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:27.601250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b3d1730b-644a-4c6a-911e-5b07c83b62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:27.608281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 505/1015] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:27.632260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990b7d8-043c-40fe-9a3a-03e3464794e9 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:27.643479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990b7d8-043c-40fe-9a3a-03e3464794e9 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:27.648201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:27.649025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:27.649302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:27.649575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] PATH_INFO: `/v3/roles/86c69e4b7605423ebcc1c4d6bc21c052` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:27.650931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] RBAC: Authorizing `identity:get_role(role_id=86c69e4b7605423ebcc1c4d6bc21c052)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:27.651969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:26:27.651969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:26:27.651969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:26:27.652840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:27.654120 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 511/1016] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:27 2021] GET /identity/v3/roles/86c69e4b7605423ebcc1c4d6bc21c052 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:27.660541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1730b-644a-4c6a-911e-5b07c83b62cc None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:27.669307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1730b-644a-4c6a-911e-5b07c83b62cc None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:27.673506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cabc6-8286-4d86-add8-b58d71579700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:27.674386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cabc6-8286-4d86-add8-b58d71579700 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:27.674670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cabc6-8286-4d86-add8-b58d71579700 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:27.674947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cabc6-8286-4d86-add8-b58d71579700 admin admin] PATH_INFO: `/v3/users/ce945381c53f4dbd900446045487f458` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:27.676109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cabc6-8286-4d86-add8-b58d71579700 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce945381c53f4dbd900446045487f458)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:27.678459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cabc6-8286-4d86-add8-b58d71579700 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:27.680024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 506/1017] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:27 2021] GET /identity/v3/users/ce945381c53f4dbd900446045487f458 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:27.685971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:27.694770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c329-296c-408e-bb91-6a28f4244152 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:27.698965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcef31-db5c-4993-be75-69c2e6a57390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:27.699811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcef31-db5c-4993-be75-69c2e6a57390 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:27.700094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcef31-db5c-4993-be75-69c2e6a57390 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:27.700368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcef31-db5c-4993-be75-69c2e6a57390 admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:27.701473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcef31-db5c-4993-be75-69c2e6a57390 admin admin] RBAC: Authorizing `identity:get_project(project_id=36c308cc13dd4268b9f547b35c08e22a)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:27.703468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcef31-db5c-4993-be75-69c2e6a57390 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:27.705062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 512/1018] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:27 2021] GET /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a => generated 311 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:27.711453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cabc6-8286-4d86-add8-b58d71579700 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:27.720226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cabc6-8286-4d86-add8-b58d71579700 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:27.725031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342372-5b12-43fe-885c-133255f8fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:27.725855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342372-5b12-43fe-885c-133255f8fe63 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:27.726129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342372-5b12-43fe-885c-133255f8fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:27.726397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342372-5b12-43fe-885c-133255f8fe63 admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a/users/ce945381c53f4dbd900446045487f458/roles/86c69e4b7605423ebcc1c4d6bc21c052` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:27.728421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0342372-5b12-43fe-885c-133255f8fe63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c308cc13dd4268b9f547b35c08e22a, user_id=ce945381c53f4dbd900446045487f458, role_id=86c69e4b7605423ebcc1c4d6bc21c052)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:27.730964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0342372-5b12-43fe-885c-133255f8fe63 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:27.743022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 507/1019] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:26:27 2021] PUT /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a/users/ce945381c53f4dbd900446045487f458/roles/86c69e4b7605423ebcc1c4d6bc21c052 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:26:29.860708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530226d-c2bb-41b0-a0bb-6c062cc6936b None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:29.861338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530226d-c2bb-41b0-a0bb-6c062cc6936b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:29.861338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530226d-c2bb-41b0-a0bb-6c062cc6936b None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:29.863013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 513/1020] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:29.869419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be28eb5-f45d-4b68-8808-63437e4e7229 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:29.869824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be28eb5-f45d-4b68-8808-63437e4e7229 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:29.869977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be28eb5-f45d-4b68-8808-63437e4e7229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:29.887017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-4be28eb5-f45d-4b68-8808-63437e4e7229 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:29.888189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4be28eb5-f45d-4b68-8808-63437e4e7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:29.942893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 508/1021] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:29.967533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530226d-c2bb-41b0-a0bb-6c062cc6936b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:29.979429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530226d-c2bb-41b0-a0bb-6c062cc6936b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:29.983486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29893feb-df88-41a6-9b11-6f5a65f0339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:29.984353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893feb-df88-41a6-9b11-6f5a65f0339f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:29.984634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893feb-df88-41a6-9b11-6f5a65f0339f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:29.984906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893feb-df88-41a6-9b11-6f5a65f0339f admin admin] PATH_INFO: `/v3/roles/86c69e4b7605423ebcc1c4d6bc21c052` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:29.986266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29893feb-df88-41a6-9b11-6f5a65f0339f admin admin] RBAC: Authorizing `identity:get_role(role_id=86c69e4b7605423ebcc1c4d6bc21c052)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:29.987885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29893feb-df88-41a6-9b11-6f5a65f0339f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:29.989181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 514/1022] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:29 2021] GET /identity/v3/roles/86c69e4b7605423ebcc1c4d6bc21c052 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:29.995329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be28eb5-f45d-4b68-8808-63437e4e7229 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:30.003379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be28eb5-f45d-4b68-8808-63437e4e7229 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:30.007607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54d395-5614-48c6-b611-d558c26de2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:30.008489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54d395-5614-48c6-b611-d558c26de2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:30.008772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54d395-5614-48c6-b611-d558c26de2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:30.009051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54d395-5614-48c6-b611-d558c26de2d3 admin admin] PATH_INFO: `/v3/users/ce945381c53f4dbd900446045487f458` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:30.010197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54d395-5614-48c6-b611-d558c26de2d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce945381c53f4dbd900446045487f458)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:30.012356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54d395-5614-48c6-b611-d558c26de2d3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:30.013875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 509/1023] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:29 2021] GET /identity/v3/users/ce945381c53f4dbd900446045487f458 => generated 286 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:30.019651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29893feb-df88-41a6-9b11-6f5a65f0339f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:30.028827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29893feb-df88-41a6-9b11-6f5a65f0339f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:30.033082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a170e9-9008-41ac-8409-b82c0d9ec2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:30.033690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a170e9-9008-41ac-8409-b82c0d9ec2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:30.033973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a170e9-9008-41ac-8409-b82c0d9ec2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:30.034251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a170e9-9008-41ac-8409-b82c0d9ec2e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:30.042043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a170e9-9008-41ac-8409-b82c0d9ec2e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:30.043762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a170e9-9008-41ac-8409-b82c0d9ec2e6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:30.051929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 515/1024] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:30 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:30.057716 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54d395-5614-48c6-b611-d558c26de2d3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:30.066288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54d395-5614-48c6-b611-d558c26de2d3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:30.070526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd9e9d-f86d-45a2-8ee9-76f94bd9dd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:30.071330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd9e9d-f86d-45a2-8ee9-76f94bd9dd4f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:30.071619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd9e9d-f86d-45a2-8ee9-76f94bd9dd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:30.071927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd9e9d-f86d-45a2-8ee9-76f94bd9dd4f admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:30.073025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd9e9d-f86d-45a2-8ee9-76f94bd9dd4f admin admin] RBAC: Authorizing `identity:get_project(project_id=36c308cc13dd4268b9f547b35c08e22a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:30.075015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd9e9d-f86d-45a2-8ee9-76f94bd9dd4f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:30.076613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 510/1025] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:30 2021] GET /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a => generated 311 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:30.082712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a170e9-9008-41ac-8409-b82c0d9ec2e6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:30.091634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a170e9-9008-41ac-8409-b82c0d9ec2e6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:30.095914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4701df-ceef-4555-9322-53cc041d83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:30.096530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4701df-ceef-4555-9322-53cc041d83c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:30.096810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4701df-ceef-4555-9322-53cc041d83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:30.097087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4701df-ceef-4555-9322-53cc041d83c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:30.097890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4701df-ceef-4555-9322-53cc041d83c1 admin admin] RBAC: Adding query filter params (role.id=86c69e4b7605423ebcc1c4d6bc21c052, scope.project.id=36c308cc13dd4268b9f547b35c08e22a, user.id=ce945381c53f4dbd900446045487f458) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:30.098197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4701df-ceef-4555-9322-53cc041d83c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:30.100832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4701df-ceef-4555-9322-53cc041d83c1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:30.106360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 516/1026] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:30 2021] GET /identity/v3/role_assignments?user.id=ce945381c53f4dbd900446045487f458&scope.project.id=36c308cc13dd4268b9f547b35c08e22a&role.id=86c69e4b7605423ebcc1c4d6bc21c052 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:32.220969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c55521-60b3-4f79-8dee-5359f5b6a0aa None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:32.221515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c55521-60b3-4f79-8dee-5359f5b6a0aa None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:32.221515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c55521-60b3-4f79-8dee-5359f5b6a0aa None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:32.223259 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 511/1027] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:32.229715 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace2b7-e726-4be4-8a26-b8ead1041b3a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:32.230107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace2b7-e726-4be4-8a26-b8ead1041b3a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:32.230269 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace2b7-e726-4be4-8a26-b8ead1041b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:32.247024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-53ace2b7-e726-4be4-8a26-b8ead1041b3a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:32.248204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-53ace2b7-e726-4be4-8a26-b8ead1041b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:32.255247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 517/1028] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:32.279568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c55521-60b3-4f79-8dee-5359f5b6a0aa None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:32.291446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c55521-60b3-4f79-8dee-5359f5b6a0aa None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:32.295461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f546b-21c8-4772-8c3b-fd2882efbf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:32.296255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f546b-21c8-4772-8c3b-fd2882efbf93 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:32.296532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f546b-21c8-4772-8c3b-fd2882efbf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:32.296797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f546b-21c8-4772-8c3b-fd2882efbf93 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:32.297891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f546b-21c8-4772-8c3b-fd2882efbf93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:32.299549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f546b-21c8-4772-8c3b-fd2882efbf93 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:32.301084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 512/1029] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:32.307074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace2b7-e726-4be4-8a26-b8ead1041b3a None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:32.315247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace2b7-e726-4be4-8a26-b8ead1041b3a None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:32.319625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2d1d-a312-4b8d-a6f9-6da0369d8bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:32.320290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2d1d-a312-4b8d-a6f9-6da0369d8bdf admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:32.320569 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2d1d-a312-4b8d-a6f9-6da0369d8bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:32.320841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2d1d-a312-4b8d-a6f9-6da0369d8bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:32.321533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2d1d-a312-4b8d-a6f9-6da0369d8bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:32.323408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2d1d-a312-4b8d-a6f9-6da0369d8bdf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:32.348147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 518/1030] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:26:32 2021] POST /identity/v3/projects => generated 311 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:34.490039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237fd6-4f6e-4e2d-9cc6-8d2ac8de49f0 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:34.490535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237fd6-4f6e-4e2d-9cc6-8d2ac8de49f0 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:34.490535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237fd6-4f6e-4e2d-9cc6-8d2ac8de49f0 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:34.492307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 513/1031] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:34.498160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331627ff-bd4e-44ae-9dc9-eaea64eafc1f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:34.498532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331627ff-bd4e-44ae-9dc9-eaea64eafc1f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:34.498721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331627ff-bd4e-44ae-9dc9-eaea64eafc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:34.516179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-331627ff-bd4e-44ae-9dc9-eaea64eafc1f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:34.517330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-331627ff-bd4e-44ae-9dc9-eaea64eafc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:34.571994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 519/1032] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:34.597846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce237fd6-4f6e-4e2d-9cc6-8d2ac8de49f0 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:34.609246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce237fd6-4f6e-4e2d-9cc6-8d2ac8de49f0 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:34.613319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6919-4fd3-4280-a4d6-990ce13cb74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:34.614085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6919-4fd3-4280-a4d6-990ce13cb74d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:34.614851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6919-4fd3-4280-a4d6-990ce13cb74d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:34.615121 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6919-4fd3-4280-a4d6-990ce13cb74d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:34.616253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad6919-4fd3-4280-a4d6-990ce13cb74d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:34.617961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad6919-4fd3-4280-a4d6-990ce13cb74d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:34.619449 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 514/1033] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:26:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:34.625387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331627ff-bd4e-44ae-9dc9-eaea64eafc1f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:34.634189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331627ff-bd4e-44ae-9dc9-eaea64eafc1f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:34.638380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfdc65-30a2-47c9-b50a-fc0919fe85ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:34.639028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfdc65-30a2-47c9-b50a-fc0919fe85ef admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:34.639311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfdc65-30a2-47c9-b50a-fc0919fe85ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:34.639586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfdc65-30a2-47c9-b50a-fc0919fe85ef admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:34.640317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfdc65-30a2-47c9-b50a-fc0919fe85ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:34.642226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfdc65-30a2-47c9-b50a-fc0919fe85ef admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:34.661454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 520/1034] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:26:34 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:36.813934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc92c5-8e23-4bbf-ae1b-fe73a0a0544a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:36.814517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc92c5-8e23-4bbf-ae1b-fe73a0a0544a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:36.814517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc92c5-8e23-4bbf-ae1b-fe73a0a0544a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:36.816284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 515/1035] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:36.824006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351ec8d-1a86-4c8c-a22b-5b9ec1ca6c31 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:36.824464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351ec8d-1a86-4c8c-a22b-5b9ec1ca6c31 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:36.824584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351ec8d-1a86-4c8c-a22b-5b9ec1ca6c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:36.842536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b351ec8d-1a86-4c8c-a22b-5b9ec1ca6c31 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:36.843689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b351ec8d-1a86-4c8c-a22b-5b9ec1ca6c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:36.851399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 521/1036] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:36.875379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc92c5-8e23-4bbf-ae1b-fe73a0a0544a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:36.886648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc92c5-8e23-4bbf-ae1b-fe73a0a0544a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:36.890714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c4b9b-c6d6-40f0-868e-9f5d4f88a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:36.891507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4b9b-c6d6-40f0-868e-9f5d4f88a762 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:36.891820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4b9b-c6d6-40f0-868e-9f5d4f88a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:36.892098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4b9b-c6d6-40f0-868e-9f5d4f88a762 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:36.902498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c4b9b-c6d6-40f0-868e-9f5d4f88a762 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:36.909056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-3b8c4b9b-c6d6-40f0-868e-9f5d4f88a762 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:36.910189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 516/1037] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:36.916957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351ec8d-1a86-4c8c-a22b-5b9ec1ca6c31 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:36.925059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351ec8d-1a86-4c8c-a22b-5b9ec1ca6c31 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:36.929375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:36.930017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:36.930296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:36.930569 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:36.931310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:36.931612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:36.933219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:36.941134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 522/1038] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:36.947245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c4b9b-c6d6-40f0-868e-9f5d4f88a762 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:36.956539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c4b9b-c6d6-40f0-868e-9f5d4f88a762 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:36.961494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4c0d-fe6e-4e44-a963-bb4d4d271b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:36.962316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4c0d-fe6e-4e44-a963-bb4d4d271b02 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:36.962595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4c0d-fe6e-4e44-a963-bb4d4d271b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:36.962862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4c0d-fe6e-4e44-a963-bb4d4d271b02 admin admin] PATH_INFO: `/v3/users/78339e49facd48729a59ae2cbfe5ebcd` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:36.976363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e4c0d-fe6e-4e44-a963-bb4d4d271b02 admin admin] RBAC: Authorizing `identity:get_user(user_id=78339e49facd48729a59ae2cbfe5ebcd)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:36.978467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e4c0d-fe6e-4e44-a963-bb4d4d271b02 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:36.980014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 517/1039] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:36 2021] GET /identity/v3/users/78339e49facd48729a59ae2cbfe5ebcd => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:36.986067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:36.994804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f060b8-e7b8-4426-bdaf-fe43fa088e80 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:36.998985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa62079-38d6-4eef-a2dd-d8443b278a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:36.999604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa62079-38d6-4eef-a2dd-d8443b278a54 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:36.999921 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa62079-38d6-4eef-a2dd-d8443b278a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:37.000192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa62079-38d6-4eef-a2dd-d8443b278a54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:37.007980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa62079-38d6-4eef-a2dd-d8443b278a54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:37.009707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa62079-38d6-4eef-a2dd-d8443b278a54 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:37.017725 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 523/1040] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:26:37.024478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4c0d-fe6e-4e44-a963-bb4d4d271b02 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:37.033736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4c0d-fe6e-4e44-a963-bb4d4d271b02 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:37.040404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9cc78-b611-4806-ab0a-f525d51ddb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:37.041300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9cc78-b611-4806-ab0a-f525d51ddb73 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:37.041580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9cc78-b611-4806-ab0a-f525d51ddb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:37.041851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9cc78-b611-4806-ab0a-f525d51ddb73 admin admin] PATH_INFO: `/v3/projects/0017173cc989466eb74d01fe59732822` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:37.042960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9cc78-b611-4806-ab0a-f525d51ddb73 admin admin] RBAC: Authorizing `identity:get_project(project_id=0017173cc989466eb74d01fe59732822)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:37.045003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9cc78-b611-4806-ab0a-f525d51ddb73 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:37.046562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 518/1041] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:37 2021] GET /identity/v3/projects/0017173cc989466eb74d01fe59732822 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:37.053162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa62079-38d6-4eef-a2dd-d8443b278a54 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:37.061249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa62079-38d6-4eef-a2dd-d8443b278a54 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:37.065553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f71d15-8e5a-4f1b-bdb3-d8d411a255fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:37.066127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71d15-8e5a-4f1b-bdb3-d8d411a255fd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:37.066406 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71d15-8e5a-4f1b-bdb3-d8d411a255fd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:37.066678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71d15-8e5a-4f1b-bdb3-d8d411a255fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:37.068030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f71d15-8e5a-4f1b-bdb3-d8d411a255fd admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=0017173cc989466eb74d01fe59732822, user.id=78339e49facd48729a59ae2cbfe5ebcd) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:37.068367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f71d15-8e5a-4f1b-bdb3-d8d411a255fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:37.070254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f71d15-8e5a-4f1b-bdb3-d8d411a255fd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:37.075348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 524/1042] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:37 2021] GET /identity/v3/role_assignments?user.id=78339e49facd48729a59ae2cbfe5ebcd&scope.project.id=0017173cc989466eb74d01fe59732822&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:39.168623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba581b09-2a19-420d-bb9c-6e4cb55ec360 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:39.169137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba581b09-2a19-420d-bb9c-6e4cb55ec360 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:39.169235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba581b09-2a19-420d-bb9c-6e4cb55ec360 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:39.170925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 519/1043] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:39.177399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be05a-c514-4dfc-a5ce-b8bb0719bc2c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:39.177957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be05a-c514-4dfc-a5ce-b8bb0719bc2c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:39.177957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be05a-c514-4dfc-a5ce-b8bb0719bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:39.195331 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1c7be05a-c514-4dfc-a5ce-b8bb0719bc2c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:39.196512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1c7be05a-c514-4dfc-a5ce-b8bb0719bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:39.203523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 525/1044] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:39.226956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba581b09-2a19-420d-bb9c-6e4cb55ec360 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:39.238141 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba581b09-2a19-420d-bb9c-6e4cb55ec360 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:39.242718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740b6f7-e3e0-4727-a0f1-758fdc14a805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:39.243473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740b6f7-e3e0-4727-a0f1-758fdc14a805 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:39.243784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740b6f7-e3e0-4727-a0f1-758fdc14a805 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:39.244062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740b6f7-e3e0-4727-a0f1-758fdc14a805 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:39.253703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740b6f7-e3e0-4727-a0f1-758fdc14a805 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:39.261467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-3740b6f7-e3e0-4727-a0f1-758fdc14a805 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:39.262596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 520/1045] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:26:39.268825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7be05a-c514-4dfc-a5ce-b8bb0719bc2c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:39.277168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7be05a-c514-4dfc-a5ce-b8bb0719bc2c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:39.281366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:39.282004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:39.282281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:39.282553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:39.283284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:39.283585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:39.285240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:39.293713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 526/1046] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:39.299666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740b6f7-e3e0-4727-a0f1-758fdc14a805 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:39.309518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740b6f7-e3e0-4727-a0f1-758fdc14a805 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:39.313704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d551ec-01f2-44b2-803c-d83e85d88e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:39.314526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d551ec-01f2-44b2-803c-d83e85d88e5b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:39.314807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d551ec-01f2-44b2-803c-d83e85d88e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:39.315082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d551ec-01f2-44b2-803c-d83e85d88e5b admin admin] PATH_INFO: `/v3/users/78339e49facd48729a59ae2cbfe5ebcd` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:39.316239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d551ec-01f2-44b2-803c-d83e85d88e5b admin admin] RBAC: Authorizing `identity:get_user(user_id=78339e49facd48729a59ae2cbfe5ebcd)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:39.318477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d551ec-01f2-44b2-803c-d83e85d88e5b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:39.320066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 521/1047] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:39 2021] GET /identity/v3/users/78339e49facd48729a59ae2cbfe5ebcd => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:39.325852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:39.334407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ac801-ac54-476a-8078-a3d485f16936 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:39.338557 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a90380-ffd9-4a0f-83e6-61312c5b9ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:39.339626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90380-ffd9-4a0f-83e6-61312c5b9ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:39.339937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90380-ffd9-4a0f-83e6-61312c5b9ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:39.340211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90380-ffd9-4a0f-83e6-61312c5b9ba9 admin admin] PATH_INFO: `/v3/projects/0017173cc989466eb74d01fe59732822` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:39.341315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a90380-ffd9-4a0f-83e6-61312c5b9ba9 admin admin] RBAC: Authorizing `identity:get_project(project_id=0017173cc989466eb74d01fe59732822)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:39.343303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a90380-ffd9-4a0f-83e6-61312c5b9ba9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:39.345041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 527/1048] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:39 2021] GET /identity/v3/projects/0017173cc989466eb74d01fe59732822 => generated 311 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:39.351445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d551ec-01f2-44b2-803c-d83e85d88e5b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:39.359969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d551ec-01f2-44b2-803c-d83e85d88e5b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:39.364093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eca80-94e3-4873-b354-1ecff0adb609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:39.365571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eca80-94e3-4873-b354-1ecff0adb609 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:39.365848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eca80-94e3-4873-b354-1ecff0adb609 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:39.366119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eca80-94e3-4873-b354-1ecff0adb609 admin admin] PATH_INFO: `/v3/projects/0017173cc989466eb74d01fe59732822/users/78339e49facd48729a59ae2cbfe5ebcd/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:39.367952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483eca80-94e3-4873-b354-1ecff0adb609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0017173cc989466eb74d01fe59732822, user_id=78339e49facd48729a59ae2cbfe5ebcd, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:39.370491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483eca80-94e3-4873-b354-1ecff0adb609 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:39.383373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 522/1049] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:26:39 2021] PUT /identity/v3/projects/0017173cc989466eb74d01fe59732822/users/78339e49facd48729a59ae2cbfe5ebcd/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:26:41.495173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1c24-bdcf-4883-a662-72a24cb1b3e5 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:41.495681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1c24-bdcf-4883-a662-72a24cb1b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:41.495681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1c24-bdcf-4883-a662-72a24cb1b3e5 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:41.497461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 528/1050] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:41.503463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050429-eb98-4a91-ad9b-526a47104896 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:41.503911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050429-eb98-4a91-ad9b-526a47104896 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:41.504017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050429-eb98-4a91-ad9b-526a47104896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:41.522180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-77050429-eb98-4a91-ad9b-526a47104896 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:41.523314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-77050429-eb98-4a91-ad9b-526a47104896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:41.577597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 523/1051] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:41.602724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d1c24-bdcf-4883-a662-72a24cb1b3e5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:41.614089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d1c24-bdcf-4883-a662-72a24cb1b3e5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:41.618768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed3a7b-fc97-4b78-aa04-34c820639b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:41.619540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3a7b-fc97-4b78-aa04-34c820639b65 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:41.619866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3a7b-fc97-4b78-aa04-34c820639b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:41.620145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3a7b-fc97-4b78-aa04-34c820639b65 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:41.629941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed3a7b-fc97-4b78-aa04-34c820639b65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:41.636617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-1bed3a7b-fc97-4b78-aa04-34c820639b65 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:41.637749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 529/1052] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:41.643972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77050429-eb98-4a91-ad9b-526a47104896 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:41.651937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77050429-eb98-4a91-ad9b-526a47104896 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:41.656105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:41.656743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:41.657017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:41.657283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:41.658014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:41.658311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:41.659945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:41.668239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 524/1053] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:41.674230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed3a7b-fc97-4b78-aa04-34c820639b65 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:41.684760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed3a7b-fc97-4b78-aa04-34c820639b65 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:41.689042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b04bc1-8f47-4291-8b88-6201f9aeaae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:41.689867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b04bc1-8f47-4291-8b88-6201f9aeaae4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:41.690148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b04bc1-8f47-4291-8b88-6201f9aeaae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:41.690421 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b04bc1-8f47-4291-8b88-6201f9aeaae4 admin admin] PATH_INFO: `/v3/users/78339e49facd48729a59ae2cbfe5ebcd` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:41.691562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b04bc1-8f47-4291-8b88-6201f9aeaae4 admin admin] RBAC: Authorizing `identity:get_user(user_id=78339e49facd48729a59ae2cbfe5ebcd)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:41.693814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b04bc1-8f47-4291-8b88-6201f9aeaae4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:41.695329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 530/1054] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:41 2021] GET /identity/v3/users/78339e49facd48729a59ae2cbfe5ebcd => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:41.701109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:41.709688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a427-019f-400d-9441-230f0c56fbdf admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:41.714083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b94f89-55b4-46ae-b495-dae55050d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:41.714684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b94f89-55b4-46ae-b495-dae55050d3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:41.714961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b94f89-55b4-46ae-b495-dae55050d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:41.715232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b94f89-55b4-46ae-b495-dae55050d3b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:41.722358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b94f89-55b4-46ae-b495-dae55050d3b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:41.724667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b94f89-55b4-46ae-b495-dae55050d3b1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:41.732526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 525/1055] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:41.738579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b04bc1-8f47-4291-8b88-6201f9aeaae4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:41.747932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b04bc1-8f47-4291-8b88-6201f9aeaae4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:41.752110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d230e-d830-4ead-8891-53bc68b252aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:41.752922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d230e-d830-4ead-8891-53bc68b252aa admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:41.753201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d230e-d830-4ead-8891-53bc68b252aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:41.753475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d230e-d830-4ead-8891-53bc68b252aa admin admin] PATH_INFO: `/v3/projects/0017173cc989466eb74d01fe59732822` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:41.754582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d230e-d830-4ead-8891-53bc68b252aa admin admin] RBAC: Authorizing `identity:get_project(project_id=0017173cc989466eb74d01fe59732822)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:41.757168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d230e-d830-4ead-8891-53bc68b252aa admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:41.758847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 531/1056] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:41 2021] GET /identity/v3/projects/0017173cc989466eb74d01fe59732822 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:41.765171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b94f89-55b4-46ae-b495-dae55050d3b1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:41.774060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b94f89-55b4-46ae-b495-dae55050d3b1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:41.778442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16595310-7e0d-4f32-ae0d-72f5a8276b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:41.779107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595310-7e0d-4f32-ae0d-72f5a8276b53 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:41.779413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595310-7e0d-4f32-ae0d-72f5a8276b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:41.779690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595310-7e0d-4f32-ae0d-72f5a8276b53 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:41.780578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16595310-7e0d-4f32-ae0d-72f5a8276b53 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=0017173cc989466eb74d01fe59732822, user.id=78339e49facd48729a59ae2cbfe5ebcd) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:41.780908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16595310-7e0d-4f32-ae0d-72f5a8276b53 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:41.782757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16595310-7e0d-4f32-ae0d-72f5a8276b53 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:41.788513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 526/1057] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:41 2021] GET /identity/v3/role_assignments?user.id=78339e49facd48729a59ae2cbfe5ebcd&scope.project.id=0017173cc989466eb74d01fe59732822&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:43.924990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c59d4-858a-448c-8950-25d995d97be1 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:43.925543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c59d4-858a-448c-8950-25d995d97be1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:43.925543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c59d4-858a-448c-8950-25d995d97be1 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:43.927992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 532/1058] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:43.933961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42015-0739-46e3-8ac2-1c33b5906fe2 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:43.934332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42015-0739-46e3-8ac2-1c33b5906fe2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:43.934519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42015-0739-46e3-8ac2-1c33b5906fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:43.951765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1ff42015-0739-46e3-8ac2-1c33b5906fe2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:43.952924 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1ff42015-0739-46e3-8ac2-1c33b5906fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:43.960508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 527/1059] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:43.983870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c59d4-858a-448c-8950-25d995d97be1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:43.995287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c59d4-858a-448c-8950-25d995d97be1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:43.999348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f4dc3-704f-4c57-86b1-c7e4043a67dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:44.000031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f4dc3-704f-4c57-86b1-c7e4043a67dd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:44.000313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f4dc3-704f-4c57-86b1-c7e4043a67dd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:44.000586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f4dc3-704f-4c57-86b1-c7e4043a67dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:44.008259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f4dc3-704f-4c57-86b1-c7e4043a67dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:44.009995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f4dc3-704f-4c57-86b1-c7e4043a67dd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:44.018005 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 533/1060] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:43 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:44.024695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff42015-0739-46e3-8ac2-1c33b5906fe2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:44.033305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff42015-0739-46e3-8ac2-1c33b5906fe2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:44.037542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbe01-24d7-441c-ba40-658aa7036cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:44.038310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbe01-24d7-441c-ba40-658aa7036cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:44.038586 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbe01-24d7-441c-ba40-658aa7036cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:44.038853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbe01-24d7-441c-ba40-658aa7036cb4 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:44.045438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbe01-24d7-441c-ba40-658aa7036cb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:44.047279 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbe01-24d7-441c-ba40-658aa7036cb4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:44.061365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-28ecbe01-24d7-441c-ba40-658aa7036cb4 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 03:26:44.062472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 528/1061] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:26:44 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:44.069322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f4dc3-704f-4c57-86b1-c7e4043a67dd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:44.077321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f4dc3-704f-4c57-86b1-c7e4043a67dd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:44.081600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5349af-3484-4c7b-824a-8da8ecde6168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:44.082230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5349af-3484-4c7b-824a-8da8ecde6168 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:44.082509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5349af-3484-4c7b-824a-8da8ecde6168 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:44.082792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5349af-3484-4c7b-824a-8da8ecde6168 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:44.084115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5349af-3484-4c7b-824a-8da8ecde6168 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:44.084420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5349af-3484-4c7b-824a-8da8ecde6168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:44.085968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5349af-3484-4c7b-824a-8da8ecde6168 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:44.093273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 534/1062] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 28 03:26:44 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:46.236716 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935809-cafc-4c02-a513-ce4cd5968409 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:46.237270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935809-cafc-4c02-a513-ce4cd5968409 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:46.237270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935809-cafc-4c02-a513-ce4cd5968409 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:46.239040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 529/1063] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:46.245471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8297ee-f544-4213-b801-a71e0a371bfc None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:46.245848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8297ee-f544-4213-b801-a71e0a371bfc None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:46.246020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8297ee-f544-4213-b801-a71e0a371bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:46.263499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6c8297ee-f544-4213-b801-a71e0a371bfc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:46.264684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6c8297ee-f544-4213-b801-a71e0a371bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:46.271732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 535/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:46.295461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935809-cafc-4c02-a513-ce4cd5968409 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:46.307365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935809-cafc-4c02-a513-ce4cd5968409 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:46.311431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34ec46-838e-4183-b744-3260b984f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:46.312113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34ec46-838e-4183-b744-3260b984f468 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:46.312396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34ec46-838e-4183-b744-3260b984f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:46.312670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34ec46-838e-4183-b744-3260b984f468 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:46.313410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34ec46-838e-4183-b744-3260b984f468 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:46.314419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-3b34ec46-838e-4183-b744-3260b984f468 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:26:46.314419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:26:46.314419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:26:46.315316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34ec46-838e-4183-b744-3260b984f468 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:46.329251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 530/1065] 10.222.0.16 () {60 vars in 1160 bytes} [Wed Jul 28 03:26:46 2021] POST /identity/v3/domains => generated 267 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:48.476241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74021-9a0d-4774-ac6b-26baf280983f None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:48.476755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74021-9a0d-4774-ac6b-26baf280983f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:48.476755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74021-9a0d-4774-ac6b-26baf280983f None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:48.478484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 536/1066] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:48.484238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2500-5ad4-4324-8bc8-c36c1a8314b7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:48.484602 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2500-5ad4-4324-8bc8-c36c1a8314b7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:48.484788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2500-5ad4-4324-8bc8-c36c1a8314b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:48.501743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-39cf2500-5ad4-4324-8bc8-c36c1a8314b7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:48.502879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-39cf2500-5ad4-4324-8bc8-c36c1a8314b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:48.556650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 531/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:48.581017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e74021-9a0d-4774-ac6b-26baf280983f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:48.593287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e74021-9a0d-4774-ac6b-26baf280983f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:48.597383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e67a-40e8-44e3-bde7-696101117029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:48.598219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e67a-40e8-44e3-bde7-696101117029 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:48.598529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e67a-40e8-44e3-bde7-696101117029 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:48.598994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e67a-40e8-44e3-bde7-696101117029 admin admin] PATH_INFO: `/v3/domains/fb42375c51c447c69e83915e018e7de4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:48.610013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e67a-40e8-44e3-bde7-696101117029 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=fb42375c51c447c69e83915e018e7de4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:48.611987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e67a-40e8-44e3-bde7-696101117029 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:48.613513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 537/1068] 10.222.0.16 () {56 vars in 1205 bytes} [Wed Jul 28 03:26:48 2021] GET /identity/v3/domains/fb42375c51c447c69e83915e018e7de4 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:48.620347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf2500-5ad4-4324-8bc8-c36c1a8314b7 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:48.628474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf2500-5ad4-4324-8bc8-c36c1a8314b7 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:48.633540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7bb80-082c-4f49-8e30-2da8a4bcd0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:48.634195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7bb80-082c-4f49-8e30-2da8a4bcd0cf admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:48.634480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7bb80-082c-4f49-8e30-2da8a4bcd0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:48.634758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7bb80-082c-4f49-8e30-2da8a4bcd0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:48.635491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7bb80-082c-4f49-8e30-2da8a4bcd0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:48.637418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7bb80-082c-4f49-8e30-2da8a4bcd0cf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:48.662335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 532/1069] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:26:48 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:26:50.783476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc19b6d-1132-498c-997f-beb991f970df None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:50.784028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc19b6d-1132-498c-997f-beb991f970df None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:50.784149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc19b6d-1132-498c-997f-beb991f970df None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:50.786383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 538/1070] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:50.792389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d5440-7eb8-44ab-86a3-04dd52206fb3 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:50.792804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d5440-7eb8-44ab-86a3-04dd52206fb3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:50.792946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d5440-7eb8-44ab-86a3-04dd52206fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:50.810517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8b2d5440-7eb8-44ab-86a3-04dd52206fb3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:50.811651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8b2d5440-7eb8-44ab-86a3-04dd52206fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:50.865393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 533/1071] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:50.890672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc19b6d-1132-498c-997f-beb991f970df None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:50.902467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc19b6d-1132-498c-997f-beb991f970df None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:50.906526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9b16d-9957-48f4-ac93-21a76168e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:50.907359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b16d-9957-48f4-ac93-21a76168e5ba admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:50.907637 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b16d-9957-48f4-ac93-21a76168e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:50.908038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b16d-9957-48f4-ac93-21a76168e5ba admin admin] PATH_INFO: `/v3/domains/fb42375c51c447c69e83915e018e7de4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:50.909155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9b16d-9957-48f4-ac93-21a76168e5ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=fb42375c51c447c69e83915e018e7de4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:50.911755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9b16d-9957-48f4-ac93-21a76168e5ba admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:50.913268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 539/1072] 10.222.0.16 () {56 vars in 1205 bytes} [Wed Jul 28 03:26:50 2021] GET /identity/v3/domains/fb42375c51c447c69e83915e018e7de4 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:50.919201 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d5440-7eb8-44ab-86a3-04dd52206fb3 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:50.927300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d5440-7eb8-44ab-86a3-04dd52206fb3 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:50.931436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591748f0-6483-4d5b-8c82-6cb5cae4ab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:50.932108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591748f0-6483-4d5b-8c82-6cb5cae4ab11 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:50.932386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591748f0-6483-4d5b-8c82-6cb5cae4ab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:50.932657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591748f0-6483-4d5b-8c82-6cb5cae4ab11 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:50.933353 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591748f0-6483-4d5b-8c82-6cb5cae4ab11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:50.935226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591748f0-6483-4d5b-8c82-6cb5cae4ab11 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:50.954411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 534/1073] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:26:50 2021] POST /identity/v3/users => generated 311 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:26:53.106222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d5fee-ef95-4ea9-9c84-16075f619efa None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:53.106786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d5fee-ef95-4ea9-9c84-16075f619efa None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:53.106786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d5fee-ef95-4ea9-9c84-16075f619efa None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:53.108568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 540/1074] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:53.115298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863035-3513-4b37-822a-197f3d1f3036 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:53.115669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863035-3513-4b37-822a-197f3d1f3036 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:53.115882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863035-3513-4b37-822a-197f3d1f3036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:53.132808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-11863035-3513-4b37-822a-197f3d1f3036 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:53.133943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-11863035-3513-4b37-822a-197f3d1f3036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:53.140875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 535/1075] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:53.165795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d5fee-ef95-4ea9-9c84-16075f619efa None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:53.177198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d5fee-ef95-4ea9-9c84-16075f619efa None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:53.181289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f9e1-bf05-48cb-8bf2-37d950ec67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:53.182059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f9e1-bf05-48cb-8bf2-37d950ec67f5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:53.182340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f9e1-bf05-48cb-8bf2-37d950ec67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:53.182614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f9e1-bf05-48cb-8bf2-37d950ec67f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:53.192966 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2f9e1-bf05-48cb-8bf2-37d950ec67f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:53.199575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-b3b2f9e1-bf05-48cb-8bf2-37d950ec67f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:53.200735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 541/1076] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:53.207083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863035-3513-4b37-822a-197f3d1f3036 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:53.216313 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863035-3513-4b37-822a-197f3d1f3036 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:53.220567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:53.221220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:53.221504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:53.221780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:53.222521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:53.222827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:53.225136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:53.233228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 536/1077] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:53.239614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f9e1-bf05-48cb-8bf2-37d950ec67f5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:53.248422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f9e1-bf05-48cb-8bf2-37d950ec67f5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:53.252563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92026d-b023-49e6-a375-96c9ad02549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:53.253394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92026d-b023-49e6-a375-96c9ad02549a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:53.253673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92026d-b023-49e6-a375-96c9ad02549a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:53.253945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92026d-b023-49e6-a375-96c9ad02549a admin admin] PATH_INFO: `/v3/users/30d2e5c9b1ac4ababd5f81e5d20c91f9` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:53.266904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92026d-b023-49e6-a375-96c9ad02549a admin admin] RBAC: Authorizing `identity:get_user(user_id=30d2e5c9b1ac4ababd5f81e5d20c91f9)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:53.269055 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92026d-b023-49e6-a375-96c9ad02549a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:53.271356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 542/1078] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:53 2021] GET /identity/v3/users/30d2e5c9b1ac4ababd5f81e5d20c91f9 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:53.277373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:53.286587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acddf-20ca-40bb-b4ee-e315dff3584e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:53.290890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a045e4-31b1-428b-92ed-a44c3a3392d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:53.291512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a045e4-31b1-428b-92ed-a44c3a3392d9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:53.291837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a045e4-31b1-428b-92ed-a44c3a3392d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:53.292117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a045e4-31b1-428b-92ed-a44c3a3392d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:53.299304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a045e4-31b1-428b-92ed-a44c3a3392d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:53.301076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a045e4-31b1-428b-92ed-a44c3a3392d9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:53.309224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 537/1079] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:53.315202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92026d-b023-49e6-a375-96c9ad02549a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:53.323868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92026d-b023-49e6-a375-96c9ad02549a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:53.328059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de068d74-6c95-47a9-8fdc-21930690dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:53.328876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068d74-6c95-47a9-8fdc-21930690dd23 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:53.329154 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068d74-6c95-47a9-8fdc-21930690dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:53.329425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068d74-6c95-47a9-8fdc-21930690dd23 admin admin] PATH_INFO: `/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:53.330537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de068d74-6c95-47a9-8fdc-21930690dd23 admin admin] RBAC: Authorizing `identity:get_project(project_id=1811d1eccd8145b58dd6abce5fa5ed28)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:53.332586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de068d74-6c95-47a9-8fdc-21930690dd23 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:53.334799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 543/1080] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:53 2021] GET /identity/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:53.341141 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a045e4-31b1-428b-92ed-a44c3a3392d9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:53.349610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a045e4-31b1-428b-92ed-a44c3a3392d9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:53.353866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec613745-3643-47ef-9959-1fda1e1fd0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:53.354481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec613745-3643-47ef-9959-1fda1e1fd0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:53.354764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec613745-3643-47ef-9959-1fda1e1fd0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:53.355040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec613745-3643-47ef-9959-1fda1e1fd0f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:53.355883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec613745-3643-47ef-9959-1fda1e1fd0f4 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=1811d1eccd8145b58dd6abce5fa5ed28, user.id=30d2e5c9b1ac4ababd5f81e5d20c91f9) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:53.356195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec613745-3643-47ef-9959-1fda1e1fd0f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:53.358040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec613745-3643-47ef-9959-1fda1e1fd0f4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:53.363084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 538/1081] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:53 2021] GET /identity/v3/role_assignments?user.id=30d2e5c9b1ac4ababd5f81e5d20c91f9&scope.project.id=1811d1eccd8145b58dd6abce5fa5ed28&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:55.448872 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285ec1-43ff-477b-9c66-3ff2aa2520cf None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:55.449378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285ec1-43ff-477b-9c66-3ff2aa2520cf None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:55.449378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285ec1-43ff-477b-9c66-3ff2aa2520cf None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:55.451103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 544/1082] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:55.456995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb4a7-2813-4f58-8a22-f5aacd28cfdf None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:55.457429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb4a7-2813-4f58-8a22-f5aacd28cfdf None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:55.458048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb4a7-2813-4f58-8a22-f5aacd28cfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:55.475481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d2dbb4a7-2813-4f58-8a22-f5aacd28cfdf None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:55.476645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d2dbb4a7-2813-4f58-8a22-f5aacd28cfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:55.483491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 539/1083] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:26:55.507326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29285ec1-43ff-477b-9c66-3ff2aa2520cf None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:55.518411 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29285ec1-43ff-477b-9c66-3ff2aa2520cf None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:55.523463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d332014-72ad-4e3b-833b-b6cc9d5e95db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:55.524255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d332014-72ad-4e3b-833b-b6cc9d5e95db admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:55.524532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d332014-72ad-4e3b-833b-b6cc9d5e95db admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:55.524800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d332014-72ad-4e3b-833b-b6cc9d5e95db admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:55.534338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d332014-72ad-4e3b-833b-b6cc9d5e95db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:55.542669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-3d332014-72ad-4e3b-833b-b6cc9d5e95db admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:55.543816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 545/1084] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:55.550058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb4a7-2813-4f58-8a22-f5aacd28cfdf None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:55.558198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb4a7-2813-4f58-8a22-f5aacd28cfdf None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:55.562311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:55.562948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:55.563226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:55.563497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:55.564263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:55.564564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:55.566153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:55.573998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 540/1085] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:55.579991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d332014-72ad-4e3b-833b-b6cc9d5e95db admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:55.590023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d332014-72ad-4e3b-833b-b6cc9d5e95db admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:55.594230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c29e8-3275-49cf-b23e-d77b306768ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:55.595051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c29e8-3275-49cf-b23e-d77b306768ab admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:55.595357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c29e8-3275-49cf-b23e-d77b306768ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:55.595628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c29e8-3275-49cf-b23e-d77b306768ab admin admin] PATH_INFO: `/v3/users/30d2e5c9b1ac4ababd5f81e5d20c91f9` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:55.596777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c29e8-3275-49cf-b23e-d77b306768ab admin admin] RBAC: Authorizing `identity:get_user(user_id=30d2e5c9b1ac4ababd5f81e5d20c91f9)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:55.599625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c29e8-3275-49cf-b23e-d77b306768ab admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:55.601142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 546/1086] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:55 2021] GET /identity/v3/users/30d2e5c9b1ac4ababd5f81e5d20c91f9 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:55.606855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:55.615462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be70ee-2672-42f4-a7aa-f26bcf885c51 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:55.619600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774435ae-f7ad-487a-bcd9-666206fad0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:55.620441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774435ae-f7ad-487a-bcd9-666206fad0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:55.620721 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774435ae-f7ad-487a-bcd9-666206fad0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:55.620994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774435ae-f7ad-487a-bcd9-666206fad0f7 admin admin] PATH_INFO: `/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:55.622087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774435ae-f7ad-487a-bcd9-666206fad0f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1811d1eccd8145b58dd6abce5fa5ed28)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:55.624110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774435ae-f7ad-487a-bcd9-666206fad0f7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:55.625633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 541/1087] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:55 2021] GET /identity/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28 => generated 361 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:55.631606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c29e8-3275-49cf-b23e-d77b306768ab admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:55.640043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c29e8-3275-49cf-b23e-d77b306768ab admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:55.644203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbb377-3939-4ca7-8a28-52290853db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:55.645030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbb377-3939-4ca7-8a28-52290853db76 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:55.645838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbb377-3939-4ca7-8a28-52290853db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:55.646153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbb377-3939-4ca7-8a28-52290853db76 admin admin] PATH_INFO: `/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28/users/30d2e5c9b1ac4ababd5f81e5d20c91f9/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:55.647929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbb377-3939-4ca7-8a28-52290853db76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1811d1eccd8145b58dd6abce5fa5ed28, user_id=30d2e5c9b1ac4ababd5f81e5d20c91f9, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:55.650493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbb377-3939-4ca7-8a28-52290853db76 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:55.663590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 547/1088] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:26:55 2021] PUT /identity/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28/users/30d2e5c9b1ac4ababd5f81e5d20c91f9/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:26:57.778171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddf7a1-32d6-4250-8eaa-e6baecf8a73b None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:57.778722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddf7a1-32d6-4250-8eaa-e6baecf8a73b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:57.778722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddf7a1-32d6-4250-8eaa-e6baecf8a73b None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:57.780515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 542/1089] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:26:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:26:57.787016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c165a1-19a8-4457-9408-7c0706cb143f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:57.787402 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c165a1-19a8-4457-9408-7c0706cb143f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:57.787568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c165a1-19a8-4457-9408-7c0706cb143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:57.804600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c5c165a1-19a8-4457-9408-7c0706cb143f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:26:57.805748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c5c165a1-19a8-4457-9408-7c0706cb143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:26:57.860205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 548/1090] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:26:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:26:57.884278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddf7a1-32d6-4250-8eaa-e6baecf8a73b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:57.896184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddf7a1-32d6-4250-8eaa-e6baecf8a73b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:57.900254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b35f09-f9be-40a5-866d-e22ac6fe4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:57.901023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35f09-f9be-40a5-866d-e22ac6fe4c90 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:57.901304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35f09-f9be-40a5-866d-e22ac6fe4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:57.901578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35f09-f9be-40a5-866d-e22ac6fe4c90 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:57.912272 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b35f09-f9be-40a5-866d-e22ac6fe4c90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:26:57.919002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-f6b35f09-f9be-40a5-866d-e22ac6fe4c90 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:26:57.920174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 543/1091] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:26:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:26:57.926437 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c165a1-19a8-4457-9408-7c0706cb143f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:57.934594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c165a1-19a8-4457-9408-7c0706cb143f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:57.938816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:57.939462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:57.939775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:57.940056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:57.940797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:57.941102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:57.942724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:57.950780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 549/1092] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:26:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:26:57.956607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b35f09-f9be-40a5-866d-e22ac6fe4c90 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:57.966646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b35f09-f9be-40a5-866d-e22ac6fe4c90 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:57.970852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f04dd-234e-4b74-be6d-7b28f6ea34b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:57.971677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f04dd-234e-4b74-be6d-7b28f6ea34b6 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:57.971983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f04dd-234e-4b74-be6d-7b28f6ea34b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:57.972255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f04dd-234e-4b74-be6d-7b28f6ea34b6 admin admin] PATH_INFO: `/v3/users/30d2e5c9b1ac4ababd5f81e5d20c91f9` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:57.974061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f04dd-234e-4b74-be6d-7b28f6ea34b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=30d2e5c9b1ac4ababd5f81e5d20c91f9)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:57.976257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f04dd-234e-4b74-be6d-7b28f6ea34b6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:57.977746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 544/1093] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:26:57 2021] GET /identity/v3/users/30d2e5c9b1ac4ababd5f81e5d20c91f9 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:57.983501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:57.992208 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d5c45-8222-4e21-ad8d-ee391de21c21 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:57.996518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f17c2b-acdf-45c5-97d9-626f927ec1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:57.997153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17c2b-acdf-45c5-97d9-626f927ec1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:57.997435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17c2b-acdf-45c5-97d9-626f927ec1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:57.997714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17c2b-acdf-45c5-97d9-626f927ec1d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:58.005383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f17c2b-acdf-45c5-97d9-626f927ec1d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:58.007113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f17c2b-acdf-45c5-97d9-626f927ec1d4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:58.015073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 550/1094] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:26:57 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:26:58.021649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f04dd-234e-4b74-be6d-7b28f6ea34b6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:58.030156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f04dd-234e-4b74-be6d-7b28f6ea34b6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:58.034301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffe163-5b58-411c-aaa5-38153ea25523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:58.035100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffe163-5b58-411c-aaa5-38153ea25523 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:58.035378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffe163-5b58-411c-aaa5-38153ea25523 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:58.035686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffe163-5b58-411c-aaa5-38153ea25523 admin admin] PATH_INFO: `/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:58.037011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffe163-5b58-411c-aaa5-38153ea25523 admin admin] RBAC: Authorizing `identity:get_project(project_id=1811d1eccd8145b58dd6abce5fa5ed28)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:58.039012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffe163-5b58-411c-aaa5-38153ea25523 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:58.040591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 545/1095] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:26:58 2021] GET /identity/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:26:58.046642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f17c2b-acdf-45c5-97d9-626f927ec1d4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:26:58.054688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f17c2b-acdf-45c5-97d9-626f927ec1d4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:26:58.058912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1794432-dde0-4c77-a161-307265b3e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:26:58.059518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1794432-dde0-4c77-a161-307265b3e8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:26:58.059833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1794432-dde0-4c77-a161-307265b3e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:26:58.060106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1794432-dde0-4c77-a161-307265b3e8a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:26:58.060902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1794432-dde0-4c77-a161-307265b3e8a1 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=1811d1eccd8145b58dd6abce5fa5ed28, user.id=30d2e5c9b1ac4ababd5f81e5d20c91f9) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:26:58.061206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1794432-dde0-4c77-a161-307265b3e8a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:26:58.062992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1794432-dde0-4c77-a161-307265b3e8a1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:26:58.069244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 551/1096] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:26:58 2021] GET /identity/v3/role_assignments?user.id=30d2e5c9b1ac4ababd5f81e5d20c91f9&scope.project.id=1811d1eccd8145b58dd6abce5fa5ed28&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:27:53.117335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f93d-650f-43c8-81f0-44b3dcfd4d2d None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:53.118395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f93d-650f-43c8-81f0-44b3dcfd4d2d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:53.118395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f93d-650f-43c8-81f0-44b3dcfd4d2d None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:53.119690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 546/1097] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:27:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:27:53.129016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981cfdd-e48e-4d75-b286-1cb575610521 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:53.129624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981cfdd-e48e-4d75-b286-1cb575610521 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:53.130052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981cfdd-e48e-4d75-b286-1cb575610521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:53.153476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1981cfdd-e48e-4d75-b286-1cb575610521 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:27:53.155237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1981cfdd-e48e-4d75-b286-1cb575610521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:27:53.169348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 552/1098] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:27:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:27:53.196150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583f93d-650f-43c8-81f0-44b3dcfd4d2d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:53.210503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583f93d-650f-43c8-81f0-44b3dcfd4d2d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:53.216109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:53.217023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:53.217309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:53.217581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:53.229167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:53.231061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:53.250075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:27:53.251338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 547/1099] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:27:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:27:53.259849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981cfdd-e48e-4d75-b286-1cb575610521 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:53.271409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981cfdd-e48e-4d75-b286-1cb575610521 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:53.276682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c7e1b-f3fa-43fe-b715-c4dca0a07ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:53.277496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7e1b-f3fa-43fe-b715-c4dca0a07ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:53.277855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7e1b-f3fa-43fe-b715-c4dca0a07ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:53.278276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7e1b-f3fa-43fe-b715-c4dca0a07ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:53.279270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c7e1b-f3fa-43fe-b715-c4dca0a07ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:53.279655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c7e1b-f3fa-43fe-b715-c4dca0a07ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:53.281598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c7e1b-f3fa-43fe-b715-c4dca0a07ab2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:53.300682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 553/1100] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:27:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:27:53.302813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:53.312620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c3203-7100-4456-810b-5a214a335ca4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:53.318220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f1b7-b000-4021-a203-923c85be3d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:53.319010 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f1b7-b000-4021-a203-923c85be3d94 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:53.319294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f1b7-b000-4021-a203-923c85be3d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:53.319572 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f1b7-b000-4021-a203-923c85be3d94 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:53.320291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7f1b7-b000-4021-a203-923c85be3d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:53.322382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7f1b7-b000-4021-a203-923c85be3d94 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:53.355919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 548/1101] 10.222.0.16 () {60 vars in 1154 bytes} [Wed Jul 28 03:27:53 2021] POST /identity/v3/users => generated 251 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:27:55.653117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92da30-01fd-41e7-bea6-f6fb06e321c9 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:55.653774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92da30-01fd-41e7-bea6-f6fb06e321c9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:55.653774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92da30-01fd-41e7-bea6-f6fb06e321c9 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:55.655521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 554/1102] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:27:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:27:55.664499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0f07-24d5-4811-9845-c80f0a4725d1 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:55.664499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0f07-24d5-4811-9845-c80f0a4725d1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:55.664499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0f07-24d5-4811-9845-c80f0a4725d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:55.685593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-57fa0f07-24d5-4811-9845-c80f0a4725d1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:27:55.687439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-57fa0f07-24d5-4811-9845-c80f0a4725d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:27:55.697502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 549/1103] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:27:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:27:55.730049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92da30-01fd-41e7-bea6-f6fb06e321c9 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:55.742564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92da30-01fd-41e7-bea6-f6fb06e321c9 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:55.746915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832c91-4671-4527-969e-d80350dccf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:55.747749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832c91-4671-4527-969e-d80350dccf18 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:55.747998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832c91-4671-4527-969e-d80350dccf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:55.748271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832c91-4671-4527-969e-d80350dccf18 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:55.760601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2832c91-4671-4527-969e-d80350dccf18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:27:55.767548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-e2832c91-4671-4527-969e-d80350dccf18 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:27:55.771599 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 555/1104] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:27:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:27:55.776437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa0f07-24d5-4811-9845-c80f0a4725d1 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:55.786076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa0f07-24d5-4811-9845-c80f0a4725d1 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:55.791229 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:55.791967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:55.792248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:55.792551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:55.793330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:55.793634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:55.795268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:55.804092 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 550/1105] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:27:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:27:55.810622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832c91-4671-4527-969e-d80350dccf18 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:55.820688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832c91-4671-4527-969e-d80350dccf18 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:55.825406 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:55.826200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:55.826481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:55.826765 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:55.838239 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:55.840389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:55.860201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:27:55.861400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 556/1106] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:27:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:27:55.868764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:55.878884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05b5b7-ff88-4fdb-af46-ab3a4bf4a848 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:55.883535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:55.884239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:55.884512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:55.884790 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:55.885569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:55.885831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:55.887467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:55.903277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 551/1107] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:27:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:27:55.908382 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:55.918539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100877-5bc8-4d07-af8e-50d428486dcb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:55.923586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:55.924437 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:55.924716 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:55.925647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:55.933481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:55.935505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:55.950063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:27:55.951970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 557/1108] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:27:55 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:27:55.958165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:55.968112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec721-90ea-4dae-88be-215ec47fa290 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:55.973739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:55.974789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:55.975294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:55.975688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:55.976669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:55.977073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:55.979026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:56.003826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 552/1109] 10.222.0.16 () {56 vars in 1165 bytes} [Wed Jul 28 03:27:55 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:27:56.011307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:56.020969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca231c48-c9e2-4681-a01b-89c34e46775d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:56.025813 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329e4f-d60b-4980-a409-44e78277ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:56.026462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329e4f-d60b-4980-a409-44e78277ad72 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:56.026741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329e4f-d60b-4980-a409-44e78277ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:56.027044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329e4f-d60b-4980-a409-44e78277ad72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:56.035998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79329e4f-d60b-4980-a409-44e78277ad72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:56.037773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79329e4f-d60b-4980-a409-44e78277ad72 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:56.047826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 558/1110] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:27:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:27:56.054165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:56.064993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d4e91-06a4-4a36-b504-aaf58bd854e6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:56.072320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:56.073181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:56.073438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:56.073719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:56.086155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:56.088252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:56.106910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:27:56.111755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 553/1111] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:27:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:27:56.115615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329e4f-d60b-4980-a409-44e78277ad72 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:56.126315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329e4f-d60b-4980-a409-44e78277ad72 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:56.132108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:56.132940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:56.133289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:56.133787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:56.135048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:56.135512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:56.137483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:56.157810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 559/1112] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:27:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:27:56.159474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:56.169352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8ea09-1fbd-4e81-8b37-b6427f3a116c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:56.174601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:56.175964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:56.176310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:56.176518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:56.187098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:56.189104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:56.204769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:27:56.206739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 554/1113] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:27:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:27:56.213783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:56.225651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a59c-fff3-4d5d-90c3-d47636169850 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:56.231031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f285c85-969c-4fbc-bd26-2b3c107c3c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:56.231693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f285c85-969c-4fbc-bd26-2b3c107c3c55 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:56.232003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f285c85-969c-4fbc-bd26-2b3c107c3c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:56.232280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f285c85-969c-4fbc-bd26-2b3c107c3c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:56.233069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f285c85-969c-4fbc-bd26-2b3c107c3c55 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:56.233376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f285c85-969c-4fbc-bd26-2b3c107c3c55 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:56.235244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f285c85-969c-4fbc-bd26-2b3c107c3c55 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:56.249930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 560/1114] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:27:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:27:56.257070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:56.267231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd38c10-f002-40b7-b365-022b1cadf443 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:56.273284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c3be4-d7bb-492d-a1c5-15f110093bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:56.273938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3be4-d7bb-492d-a1c5-15f110093bbf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:56.274235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3be4-d7bb-492d-a1c5-15f110093bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:56.274480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3be4-d7bb-492d-a1c5-15f110093bbf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:56.275300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c3be4-d7bb-492d-a1c5-15f110093bbf admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=d2b5335392b4400d94f1dfce0e010b74) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:56.275609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c3be4-d7bb-492d-a1c5-15f110093bbf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:56.277478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c3be4-d7bb-492d-a1c5-15f110093bbf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:56.283375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 555/1115] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:27:56 2021] GET /identity/v3/role_assignments?user.id=d2b5335392b4400d94f1dfce0e010b74&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:27:58.433196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4e1d-5b6b-4751-850c-34944e61052d None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.433721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4e1d-5b6b-4751-850c-34944e61052d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.433721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4e1d-5b6b-4751-850c-34944e61052d None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.435426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 561/1116] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:27:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:27:58.441710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6efa9-4632-4d75-b794-e8111517326f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.442142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6efa9-4632-4d75-b794-e8111517326f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.442241 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6efa9-4632-4d75-b794-e8111517326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.459640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2cc6efa9-4632-4d75-b794-e8111517326f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:27:58.460828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2cc6efa9-4632-4d75-b794-e8111517326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:27:58.468455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 556/1117] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:27:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:27:58.492726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad4e1d-5b6b-4751-850c-34944e61052d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.504726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad4e1d-5b6b-4751-850c-34944e61052d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.508843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc999210-dcb9-4538-961b-8857cecc9828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.509626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc999210-dcb9-4538-961b-8857cecc9828 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.509906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc999210-dcb9-4538-961b-8857cecc9828 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.510211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc999210-dcb9-4538-961b-8857cecc9828 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.523987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc999210-dcb9-4538-961b-8857cecc9828 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:27:58.532014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-fc999210-dcb9-4538-961b-8857cecc9828 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:27:58.533552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 562/1118] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:27:58.541726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6efa9-4632-4d75-b794-e8111517326f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.550858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6efa9-4632-4d75-b794-e8111517326f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.555440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.556159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.556426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.556696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.557455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:58.557742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.559342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.567737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 557/1119] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:27:58.574056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc999210-dcb9-4538-961b-8857cecc9828 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.584651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc999210-dcb9-4538-961b-8857cecc9828 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.590562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.591531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.591972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.592373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.604841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.607389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.628669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:27:58.630211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 563/1120] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:27:58.637470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.647327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bdebb-2059-41fa-b0ea-c397a23e4619 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.654075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.654726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.655037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.655275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.656022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:58.656320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.657895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.671731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 558/1121] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:27:58.677298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.686352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024091f4-a345-47ac-8092-e4495406fa1f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.690495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.691937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.692214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.692477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.699914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.701900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.718033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:27:58.719199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 564/1122] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:27:58.726607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.738501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8941ce-1c8f-4eba-b61d-f7da85505740 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.742541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.743205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.743485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.743790 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.744657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:58.745065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.746905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.765427 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 559/1123] 10.222.0.16 () {56 vars in 1165 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:27:58.772605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.781770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227df37-d5c4-4d93-b071-326099a900b7 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.786318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.787094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.787376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.787661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.797778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.799596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.817604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:27:58.818784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 565/1124] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:27:58.825303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.834526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9716dc-f4af-476e-9998-c45b4a8f6e80 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.839934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.840593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.840881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.841152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.841874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:58.842193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.843788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.856157 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 560/1125] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:27:58.863042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.872895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4865e-15a2-45dc-aeac-f16780bd2c25 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.877369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.878790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.879222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.879539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.886500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.888488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.904513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:27:58.906276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 566/1126] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:27:58.912980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.922354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1286d62-aea1-4eb1-9379-7ad6e5039003 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.927848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7bc8-d0ba-4721-8749-7983200fc9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.928507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7bc8-d0ba-4721-8749-7983200fc9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.928787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7bc8-d0ba-4721-8749-7983200fc9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.929064 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7bc8-d0ba-4721-8749-7983200fc9a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.929940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d7bc8-d0ba-4721-8749-7983200fc9a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:27:58.930249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d7bc8-d0ba-4721-8749-7983200fc9a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.932340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d7bc8-d0ba-4721-8749-7983200fc9a6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:58.947428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 561/1127] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:27:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:27:58.954520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:27:58.967068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499dc6-a7e9-49d8-bdcc-5193ab80d467 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:27:58.973722 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b4b97-3c9f-4a3e-a213-1c9d12b8bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:27:58.974730 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b4b97-3c9f-4a3e-a213-1c9d12b8bfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:27:58.975080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b4b97-3c9f-4a3e-a213-1c9d12b8bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:27:58.975440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b4b97-3c9f-4a3e-a213-1c9d12b8bfd2 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/d2b5335392b4400d94f1dfce0e010b74/roles/2b4c5582fd5d417996790d0ed9464d51` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:27:58.993148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b4b97-3c9f-4a3e-a213-1c9d12b8bfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=d2b5335392b4400d94f1dfce0e010b74, role_id=2b4c5582fd5d417996790d0ed9464d51)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:27:58.995824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b4b97-3c9f-4a3e-a213-1c9d12b8bfd2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:27:59.008314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 567/1128] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:27:58 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/d2b5335392b4400d94f1dfce0e010b74/roles/2b4c5582fd5d417996790d0ed9464d51 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:28:01.492477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f4a0-d90f-4856-9ec3-dea44ed3418d None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.493032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f4a0-d90f-4856-9ec3-dea44ed3418d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.493032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f4a0-d90f-4856-9ec3-dea44ed3418d None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.495411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 562/1129] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:28:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:28:01.501958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aecc2c-40d7-4d33-b779-b8037d7a40f6 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.502420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aecc2c-40d7-4d33-b779-b8037d7a40f6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.502528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aecc2c-40d7-4d33-b779-b8037d7a40f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.521839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-14aecc2c-40d7-4d33-b779-b8037d7a40f6 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:28:01.523015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-14aecc2c-40d7-4d33-b779-b8037d7a40f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:28:01.583425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 568/1130] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:28:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:28:01.611080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f4a0-d90f-4856-9ec3-dea44ed3418d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:01.624562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f4a0-d90f-4856-9ec3-dea44ed3418d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:01.630003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445eee-cca3-41c4-83a7-6f6c70a8228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:01.630766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445eee-cca3-41c4-83a7-6f6c70a8228d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.631105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445eee-cca3-41c4-83a7-6f6c70a8228d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.631360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445eee-cca3-41c4-83a7-6f6c70a8228d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.642222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da445eee-cca3-41c4-83a7-6f6c70a8228d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:28:01.650669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-da445eee-cca3-41c4-83a7-6f6c70a8228d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:28:01.651938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 563/1131] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:01.659478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aecc2c-40d7-4d33-b779-b8037d7a40f6 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:01.669396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aecc2c-40d7-4d33-b779-b8037d7a40f6 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:01.676086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:01.676920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.677268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.677764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.678513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] RBAC: Adding query filter params (name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:01.678815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:01.680439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:01.691753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 569/1132] 10.222.0.16 () {56 vars in 1125 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:01.697021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445eee-cca3-41c4-83a7-6f6c70a8228d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:01.707713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445eee-cca3-41c4-83a7-6f6c70a8228d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:01.712235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:01.713002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.713324 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.713553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.725371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:01.727519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:01.747210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:28:01.748362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 564/1133] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:28:01.755672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:01.765333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad7afd-b5be-40cd-a558-5500561dd64a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:01.771565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:01.772701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.773090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.773431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.774463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:01.774978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:01.776953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:01.791407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 570/1134] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:28:01.798221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:01.808090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fda88-13dc-4600-8e3c-0842f4d7163a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:01.812238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:01.813036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.813315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.813585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.821156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:01.823213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:01.837714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:28:01.838871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 565/1135] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:01.848078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:01.859697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0de4a-d385-4f80-8662-488bb3197862 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:01.864043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:01.864704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.864981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.865254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.866081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:01.866385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:01.868748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:01.889102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 571/1136] 10.222.0.16 () {56 vars in 1165 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:01.896108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:01.906204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da84ba-3f6b-4095-9506-fa1996761be4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:01.911498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b1d98-34ea-44f4-9dfa-680e00caf54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:01.912195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b1d98-34ea-44f4-9dfa-680e00caf54f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.912487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b1d98-34ea-44f4-9dfa-680e00caf54f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.912762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b1d98-34ea-44f4-9dfa-680e00caf54f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.920183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b1d98-34ea-44f4-9dfa-680e00caf54f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:01.922005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b1d98-34ea-44f4-9dfa-680e00caf54f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:01.930704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 566/1137] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:28:01.937736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:01.947022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0770e-99c7-467c-a91d-25df9b144433 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:01.952237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:01.953207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:01.953408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:01.953650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:01.966537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:01.968386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:01.988587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:28:01.990188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 572/1138] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:01.997867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b1d98-34ea-44f4-9dfa-680e00caf54f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:02.006408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b1d98-34ea-44f4-9dfa-680e00caf54f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:02.011311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:02.012065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:02.012394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:02.012731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:02.013505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:02.013811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:02.015676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:02.030288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 567/1139] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:28:02.038064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:02.051028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336920d-fd70-4089-9098-a649817985a6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:02.057809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:02.059114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:02.059634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:02.060076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:02.073384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:02.076965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:02.091106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:28:02.092324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 573/1140] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:28:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:02.099972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:02.109657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea02612-38c8-4371-a42d-9e1a80fd0e28 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:02.115081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ed5b3-48fd-42b8-a54e-f22c2fd134e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:02.115861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed5b3-48fd-42b8-a54e-f22c2fd134e6 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:02.116218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed5b3-48fd-42b8-a54e-f22c2fd134e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:02.116562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed5b3-48fd-42b8-a54e-f22c2fd134e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:02.117426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ed5b3-48fd-42b8-a54e-f22c2fd134e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:02.117840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ed5b3-48fd-42b8-a54e-f22c2fd134e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:02.119847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ed5b3-48fd-42b8-a54e-f22c2fd134e6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:02.134599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 568/1141] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:28:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:02.141339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:02.151655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04cff9-3acb-4e9b-beab-a0eea05c3f22 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:02.159993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19ea64-818a-41d2-b37b-d3fe8e7c9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:02.160940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ea64-818a-41d2-b37b-d3fe8e7c9638 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:02.161310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ea64-818a-41d2-b37b-d3fe8e7c9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:02.161750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ea64-818a-41d2-b37b-d3fe8e7c9638 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:02.162828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19ea64-818a-41d2-b37b-d3fe8e7c9638 admin admin] RBAC: Adding query filter params (role.id=2b4c5582fd5d417996790d0ed9464d51, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=d2b5335392b4400d94f1dfce0e010b74) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:02.163358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19ea64-818a-41d2-b37b-d3fe8e7c9638 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:02.165241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19ea64-818a-41d2-b37b-d3fe8e7c9638 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:02.172074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 574/1142] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:28:02 2021] GET /identity/v3/role_assignments?user.id=d2b5335392b4400d94f1dfce0e010b74&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=2b4c5582fd5d417996790d0ed9464d51 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:04.501116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb974c43-aa9c-4294-a472-314c41217bec None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.501658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb974c43-aa9c-4294-a472-314c41217bec None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.501658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb974c43-aa9c-4294-a472-314c41217bec None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.503922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 569/1143] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:28:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:28:04.510794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b0c3-9df9-41c1-80e9-1d93dbe57363 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.511243 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b0c3-9df9-41c1-80e9-1d93dbe57363 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.511365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b0c3-9df9-41c1-80e9-1d93dbe57363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.530594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f712b0c3-9df9-41c1-80e9-1d93dbe57363 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:28:04.531773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f712b0c3-9df9-41c1-80e9-1d93dbe57363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:28:04.540880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 575/1144] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:28:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:28:04.567535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb974c43-aa9c-4294-a472-314c41217bec None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.579472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb974c43-aa9c-4294-a472-314c41217bec None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.584637 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73d675-f0de-4ed9-8e55-24e90bd06abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.585392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73d675-f0de-4ed9-8e55-24e90bd06abd admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.585674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73d675-f0de-4ed9-8e55-24e90bd06abd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.585947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73d675-f0de-4ed9-8e55-24e90bd06abd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.596852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73d675-f0de-4ed9-8e55-24e90bd06abd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:28:04.603546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-4d73d675-f0de-4ed9-8e55-24e90bd06abd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:28:04.604757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 570/1145] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:04.611311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712b0c3-9df9-41c1-80e9-1d93dbe57363 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.620346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712b0c3-9df9-41c1-80e9-1d93dbe57363 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.625348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.626148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.626427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.626780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.627724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:04.628562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.630134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:04.638412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 576/1146] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:04.645340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73d675-f0de-4ed9-8e55-24e90bd06abd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.655027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73d675-f0de-4ed9-8e55-24e90bd06abd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.660789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.661576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.661864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.662136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.672863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.674891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:04.693662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:28:04.694879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 571/1147] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:04.703786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.714949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567acf-351d-4a51-b7a4-1d2937256449 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.719579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.720267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.720552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.720851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.722026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:04.722345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.724053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:04.736780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 577/1148] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:04.744077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.754479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5038a4-255b-4bb5-bb11-2bd3a593f463 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.759123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.759959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.760242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.760520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.768294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.770942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:04.785670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:28:04.786880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 572/1149] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:04.793408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.804515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ced17-a8b9-4f94-a72c-c84e9ebe7b0a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.809046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.809710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.809994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.810273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.811114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:04.811426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.813378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:04.834299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 578/1150] 10.222.0.16 () {56 vars in 1165 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:04.840990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.850816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf8da9-98da-49a3-ad65-3d53ab1fb0cc admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.855530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0536d-3a26-47cb-9060-6aa2eef01d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.856211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0536d-3a26-47cb-9060-6aa2eef01d5b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.856496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0536d-3a26-47cb-9060-6aa2eef01d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.856772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0536d-3a26-47cb-9060-6aa2eef01d5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.864835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0536d-3a26-47cb-9060-6aa2eef01d5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.866585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0536d-3a26-47cb-9060-6aa2eef01d5b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:04.875783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 573/1151] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:28:04.882499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.891879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80dbdd-258b-4564-afa4-916f001c7921 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.897610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.898535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.898771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.899048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.910316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.912238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:04.929541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:28:04.930733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 579/1152] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:04.936995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0536d-3a26-47cb-9060-6aa2eef01d5b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.945611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0536d-3a26-47cb-9060-6aa2eef01d5b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.949936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.950589 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.950873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.951148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.951895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:04.952199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.953846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:04.966488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 574/1153] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:04.973626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:04.983618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d43d-3ec6-4abc-912a-f1ba00ec59ae admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:04.988254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:04.989090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:04.989377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:04.989685 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:04.997162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:04.999436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:05.013488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:28:05.014677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 580/1154] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:28:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:28:05.022041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:05.031338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2c1d-4d51-4a76-9c55-4a2b5089b152 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:05.037691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c433554-7f31-4492-b979-9f36d38f7b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:05.040046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433554-7f31-4492-b979-9f36d38f7b99 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:05.040336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433554-7f31-4492-b979-9f36d38f7b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:05.040648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433554-7f31-4492-b979-9f36d38f7b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:05.041409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c433554-7f31-4492-b979-9f36d38f7b99 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:05.041714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c433554-7f31-4492-b979-9f36d38f7b99 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:05.043789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c433554-7f31-4492-b979-9f36d38f7b99 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:05.061853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 575/1155] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:28:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:05.069513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:05.083575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e431a-64fa-4cb6-8482-6160ad9984eb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:05.089897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788965f4-fc85-4141-9b7b-6ea8a626f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:05.090555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788965f4-fc85-4141-9b7b-6ea8a626f159 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:05.090834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788965f4-fc85-4141-9b7b-6ea8a626f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:05.091107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788965f4-fc85-4141-9b7b-6ea8a626f159 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:05.091979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788965f4-fc85-4141-9b7b-6ea8a626f159 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=d2b5335392b4400d94f1dfce0e010b74) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:05.092286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788965f4-fc85-4141-9b7b-6ea8a626f159 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:05.094155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788965f4-fc85-4141-9b7b-6ea8a626f159 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:05.100616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 581/1156] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:28:05 2021] GET /identity/v3/role_assignments?user.id=d2b5335392b4400d94f1dfce0e010b74&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:07.383920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3502d9-cc2b-44b0-8ab2-fee4a8cbee5a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.384444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3502d9-cc2b-44b0-8ab2-fee4a8cbee5a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.384444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3502d9-cc2b-44b0-8ab2-fee4a8cbee5a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.387610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 576/1157] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:28:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:28:07.392038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f29b9-e7a8-445b-835f-c2a134ad19ac None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.392534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f29b9-e7a8-445b-835f-c2a134ad19ac None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.392640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f29b9-e7a8-445b-835f-c2a134ad19ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.410918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1e2f29b9-e7a8-445b-835f-c2a134ad19ac None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:28:07.412149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1e2f29b9-e7a8-445b-835f-c2a134ad19ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:28:07.419674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 582/1158] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:28:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:28:07.447210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3502d9-cc2b-44b0-8ab2-fee4a8cbee5a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.459521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3502d9-cc2b-44b0-8ab2-fee4a8cbee5a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.464084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac3a55-a20c-47a8-8616-7fd969c54910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.465146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac3a55-a20c-47a8-8616-7fd969c54910 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.465506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac3a55-a20c-47a8-8616-7fd969c54910 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.465743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac3a55-a20c-47a8-8616-7fd969c54910 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.476858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac3a55-a20c-47a8-8616-7fd969c54910 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:28:07.484253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-43ac3a55-a20c-47a8-8616-7fd969c54910 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:28:07.485581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 577/1159] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:07.493229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f29b9-e7a8-445b-835f-c2a134ad19ac None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.502172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f29b9-e7a8-445b-835f-c2a134ad19ac None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.506573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.507231 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.507507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.507805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.508533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:07.508879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.510656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.519549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 583/1160] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:07.526064 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac3a55-a20c-47a8-8616-7fd969c54910 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.536166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac3a55-a20c-47a8-8616-7fd969c54910 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.540773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.541632 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.541916 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.542194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.554013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.556420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.574577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:28:07.575823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 578/1161] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:07.582863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.593168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b485f-a2ac-4af6-98bc-c70bdf8a05ef admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.598006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.598789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.599078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.599354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.600112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:07.600443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.602007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.619649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 584/1162] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:07.620556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.631124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a609e9-a22c-4314-94f4-75cfa4fce9aa admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.636531 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.637489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.637831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.638204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.647971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.650331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.667889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:28:07.669242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 579/1163] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:07.676656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.686378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242e72-176b-40a1-ae3f-13e2d65bb7ad admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.691489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.692181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.692458 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.692771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.693687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:07.694740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.695941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.719844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 585/1164] 10.222.0.16 () {56 vars in 1165 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:07.721007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.732641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093fc6d-41b9-4b1a-816f-c99dd2aaf71f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.738593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.739587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.740040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.740500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.753474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.755360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.775286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:28:07.777529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 580/1165] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:28:07.784885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.794386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960934be-a9c6-47be-bb90-5b3155fe8629 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.798930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.799609 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.800906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.801227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.801978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:07.802323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.804050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.823444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 586/1166] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:07.825101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.836902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ff68d-b96f-4c50-889f-3a7706fa7ab1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.843727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.844610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.844958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.845295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.853581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.856230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.873507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:28:07.874901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 581/1167] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:07.883220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.895416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf28ec5-e3fb-4e03-8b3c-ad0f7d00fe80 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.900948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295ce5b-80ff-4760-b215-ccd0689ea123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.901735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295ce5b-80ff-4760-b215-ccd0689ea123 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.902152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295ce5b-80ff-4760-b215-ccd0689ea123 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.902427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295ce5b-80ff-4760-b215-ccd0689ea123 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.903353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295ce5b-80ff-4760-b215-ccd0689ea123 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:07.903873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295ce5b-80ff-4760-b215-ccd0689ea123 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.906164 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295ce5b-80ff-4760-b215-ccd0689ea123 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.920821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 587/1168] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:28:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:07.928359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:07.938934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1c755-caee-41e5-9553-96b1bfa9e37c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:07.944406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb8cd1-160e-4bb7-b8ef-62f8b8a60e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:07.945441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb8cd1-160e-4bb7-b8ef-62f8b8a60e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:07.945815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb8cd1-160e-4bb7-b8ef-62f8b8a60e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:07.946193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb8cd1-160e-4bb7-b8ef-62f8b8a60e90 admin admin] PATH_INFO: `/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/d2b5335392b4400d94f1dfce0e010b74/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:07.948315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb8cd1-160e-4bb7-b8ef-62f8b8a60e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdc0d5c968408dbf1eaaafced2d209, user_id=d2b5335392b4400d94f1dfce0e010b74, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:07.951610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb8cd1-160e-4bb7-b8ef-62f8b8a60e90 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:07.966406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 582/1169] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Jul 28 03:28:07 2021] PUT /identity/v3/projects/9cbdc0d5c968408dbf1eaaafced2d209/users/d2b5335392b4400d94f1dfce0e010b74/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:28:10.261872 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63d72-6206-4eaa-ad72-0fc112303835 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.262446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63d72-6206-4eaa-ad72-0fc112303835 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.262446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63d72-6206-4eaa-ad72-0fc112303835 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.264313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 588/1170] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:28:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:28:10.270619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ddcf-c79a-415a-ba49-cf359f72eebd None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.271061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ddcf-c79a-415a-ba49-cf359f72eebd None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.271164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ddcf-c79a-415a-ba49-cf359f72eebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.288950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d397ddcf-c79a-415a-ba49-cf359f72eebd None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:28:10.290100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d397ddcf-c79a-415a-ba49-cf359f72eebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:28:10.344255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 583/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:28:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:28:10.369157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c63d72-6206-4eaa-ad72-0fc112303835 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.380499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c63d72-6206-4eaa-ad72-0fc112303835 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.384505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10745d-a5ee-4fad-9593-6fadaee7bf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.385279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10745d-a5ee-4fad-9593-6fadaee7bf11 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.385557 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10745d-a5ee-4fad-9593-6fadaee7bf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.385829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10745d-a5ee-4fad-9593-6fadaee7bf11 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.396210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10745d-a5ee-4fad-9593-6fadaee7bf11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:28:10.402839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-8d10745d-a5ee-4fad-9593-6fadaee7bf11 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:28:10.403993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 589/1172] 10.222.0.16 () {56 vars in 1118 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:10.410709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397ddcf-c79a-415a-ba49-cf359f72eebd None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.418822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397ddcf-c79a-415a-ba49-cf359f72eebd None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.423036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.423684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.424064 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.424340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.425193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:10.425444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.427037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.434885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 584/1173] 10.222.0.16 () {56 vars in 1121 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:28:10.441344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10745d-a5ee-4fad-9593-6fadaee7bf11 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.450546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10745d-a5ee-4fad-9593-6fadaee7bf11 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.454732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.455470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.455791 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.456652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.466578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.468463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.484753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:28:10.485870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 590/1174] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:10.491982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.500588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3bf50-f648-4983-b5bb-070e6168931e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.505325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.505955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.506232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.506505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.507205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:10.507530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.509115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.520696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 585/1175] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:28:10.526459 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.535320 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba239a8-a22d-4854-b235-5971b17da272 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.539552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.540343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.540622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.540890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.547836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.549847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.563254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:28:10.564389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 591/1176] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:10.570611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.579168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7813c6-8002-48b2-9f2e-879780611fd4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.584073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.584730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.585008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.585294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.586097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:10.586399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.588240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.605198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 586/1177] 10.222.0.16 () {56 vars in 1165 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:10.610994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.620279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb478fb-773a-49e2-bab7-801d50095c01 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.624473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad59ec-c4aa-4c6b-ba13-831dd004a7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.625098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad59ec-c4aa-4c6b-ba13-831dd004a7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.625374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad59ec-c4aa-4c6b-ba13-831dd004a7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.625644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad59ec-c4aa-4c6b-ba13-831dd004a7b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.632849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad59ec-c4aa-4c6b-ba13-831dd004a7b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.634490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad59ec-c4aa-4c6b-ba13-831dd004a7b4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.642435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 592/1178] 10.222.0.16 () {58 vars in 1325 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:28:10.648136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.656552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1079bf-e677-446f-b817-9a7cebd26420 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.661351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.662100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.662373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.662640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.672235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.674030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.690469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:28:10.691641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 587/1179] 10.222.0.16 () {56 vars in 1130 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:28:10.697323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad59ec-c4aa-4c6b-ba13-831dd004a7b4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.705124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad59ec-c4aa-4c6b-ba13-831dd004a7b4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.709446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.710064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.710338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.710605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.711323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:10.711647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.713217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.725097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 593/1180] 10.222.0.16 () {56 vars in 1131 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:10.731036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.740514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca642f29-85e0-40ea-8dab-1bcea2ca5a2c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.744762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.745545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.745828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.746102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.752659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.754617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.767167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING keystone.server.flask.application [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:28:10.768303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 588/1181] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:10.774460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.783833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680a703-5a0c-48e0-afc5-a41795ee3636 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.788612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f409-91eb-4d88-9db2-903993ea37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.789245 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f409-91eb-4d88-9db2-903993ea37fa admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.789526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f409-91eb-4d88-9db2-903993ea37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.789802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f409-91eb-4d88-9db2-903993ea37fa admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.790574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f409-91eb-4d88-9db2-903993ea37fa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:10.790881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f409-91eb-4d88-9db2-903993ea37fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.792743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f409-91eb-4d88-9db2-903993ea37fa admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.805087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 594/1182] 10.222.0.16 () {56 vars in 1170 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:28:10.811315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:10.821712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3c53-3586-4e6f-95b8-55b74f45f22e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:10.825918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5ebe0-3e57-44d6-896d-497bccfc7187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:10.826542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ebe0-3e57-44d6-896d-497bccfc7187 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:10.826824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ebe0-3e57-44d6-896d-497bccfc7187 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:10.827097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ebe0-3e57-44d6-896d-497bccfc7187 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:10.827954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5ebe0-3e57-44d6-896d-497bccfc7187 admin admin] RBAC: Adding query filter params (role.id=4603f7973a2c4eb59397a4b7f0c6638c, scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209, user.id=d2b5335392b4400d94f1dfce0e010b74) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:10.828264 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5ebe0-3e57-44d6-896d-497bccfc7187 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:10.830096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5ebe0-3e57-44d6-896d-497bccfc7187 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:10.836387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 589/1183] 10.222.0.16 () {56 vars in 1396 bytes} [Wed Jul 28 03:28:10 2021] GET /identity/v3/role_assignments?user.id=d2b5335392b4400d94f1dfce0e010b74&scope.project.id=9cbdc0d5c968408dbf1eaaafced2d209&role.id=4603f7973a2c4eb59397a4b7f0c6638c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:12.975077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cba984-1e84-4ead-aa52-becdc0a60583 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:12.975653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cba984-1e84-4ead-aa52-becdc0a60583 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:12.975852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cba984-1e84-4ead-aa52-becdc0a60583 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:12.978209 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 595/1184] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:28:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:28:12.984110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be84311-df34-435c-809b-55d8a8004b31 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:12.984525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be84311-df34-435c-809b-55d8a8004b31 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:12.984657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be84311-df34-435c-809b-55d8a8004b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:13.001549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9be84311-df34-435c-809b-55d8a8004b31 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:28:13.002698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9be84311-df34-435c-809b-55d8a8004b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:28:13.009791 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 590/1185] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:28:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:28:13.032581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cba984-1e84-4ead-aa52-becdc0a60583 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:13.047339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cba984-1e84-4ead-aa52-becdc0a60583 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:13.053896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:13.055113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:13.055479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:13.055833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:13.056740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:13.058365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:13.070588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:28:13.071828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 596/1186] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:28:13 2021] GET /identity/v3/services/placement => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:13.078388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be84311-df34-435c-809b-55d8a8004b31 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:13.088479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be84311-df34-435c-809b-55d8a8004b31 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:13.093829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a66aa-1ba5-46ff-9785-88abf6eb891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:13.094705 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a66aa-1ba5-46ff-9785-88abf6eb891a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:13.095252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a66aa-1ba5-46ff-9785-88abf6eb891a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:13.095562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a66aa-1ba5-46ff-9785-88abf6eb891a admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:13.097316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a66aa-1ba5-46ff-9785-88abf6eb891a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:13.097937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a66aa-1ba5-46ff-9785-88abf6eb891a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:13.099894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a66aa-1ba5-46ff-9785-88abf6eb891a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:13.106006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 591/1187] 10.222.0.16 () {56 vars in 1138 bytes} [Wed Jul 28 03:28:13 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:13.113672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:13.124457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e84f73-31f3-42e4-af83-a9d984174cc5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:13.130381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3da8-3e5b-4122-8dd0-f9f57d2ba818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:13.131041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3da8-3e5b-4122-8dd0-f9f57d2ba818 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:13.131311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3da8-3e5b-4122-8dd0-f9f57d2ba818 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:13.131590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3da8-3e5b-4122-8dd0-f9f57d2ba818 admin admin] PATH_INFO: `/v3/services` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:13.132330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e3da8-3e5b-4122-8dd0-f9f57d2ba818 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:13.132638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e3da8-3e5b-4122-8dd0-f9f57d2ba818 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:13.134229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e3da8-3e5b-4122-8dd0-f9f57d2ba818 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:13.139244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 597/1188] 10.222.0.16 () {56 vars in 1138 bytes} [Wed Jul 28 03:28:13 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:15.237369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a571-cfdf-4cba-8005-c956c6920505 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:15.237947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a571-cfdf-4cba-8005-c956c6920505 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:15.237947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a571-cfdf-4cba-8005-c956c6920505 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:15.239693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 592/1189] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:28:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:28:15.245361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0146730-7653-42fe-82c1-558e08d340a3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:15.245727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0146730-7653-42fe-82c1-558e08d340a3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:15.245906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0146730-7653-42fe-82c1-558e08d340a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:15.263227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d0146730-7653-42fe-82c1-558e08d340a3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:28:15.264389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d0146730-7653-42fe-82c1-558e08d340a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:28:15.272007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 598/1190] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:28:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:28:15.294612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a571-cfdf-4cba-8005-c956c6920505 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:15.306469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a571-cfdf-4cba-8005-c956c6920505 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:15.310724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176285c4-b5aa-4423-b145-21e5fd1caaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:15.311371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176285c4-b5aa-4423-b145-21e5fd1caaef admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:15.311651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176285c4-b5aa-4423-b145-21e5fd1caaef admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:15.311950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176285c4-b5aa-4423-b145-21e5fd1caaef admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:15.312667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176285c4-b5aa-4423-b145-21e5fd1caaef admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:15.314255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176285c4-b5aa-4423-b145-21e5fd1caaef admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:15.328110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 593/1191] 10.222.0.16 () {60 vars in 1163 bytes} [Wed Jul 28 03:28:15 2021] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:28:17.473251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6164e5-3b02-45d7-86fb-000fa0695338 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:17.473749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6164e5-3b02-45d7-86fb-000fa0695338 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:17.473749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6164e5-3b02-45d7-86fb-000fa0695338 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:17.475477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 599/1192] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:28:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:28:17.481313 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd6d2-19b1-4c84-ad2a-ed4319a6051b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:17.481683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd6d2-19b1-4c84-ad2a-ed4319a6051b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:17.481877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd6d2-19b1-4c84-ad2a-ed4319a6051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:17.499439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-524bd6d2-19b1-4c84-ad2a-ed4319a6051b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:28:17.500745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-524bd6d2-19b1-4c84-ad2a-ed4319a6051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:28:17.516540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 594/1193] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:28:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:28:17.540766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6164e5-3b02-45d7-86fb-000fa0695338 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:17.552735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6164e5-3b02-45d7-86fb-000fa0695338 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:17.556813 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:17.557582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:17.557864 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:17.558136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:17.558778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:17.560396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:17.570999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:28:17.572141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 600/1194] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:28:17 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:17.578410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd6d2-19b1-4c84-ad2a-ed4319a6051b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:17.587857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd6d2-19b1-4c84-ad2a-ed4319a6051b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:17.593388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:17.594294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:17.594676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:17.595043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:17.595981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:17.596285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:17.598564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:17.603496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 595/1195] 10.222.0.16 () {56 vars in 1138 bytes} [Wed Jul 28 03:28:17 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:17.609944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:17.618778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3cf9-ae51-4d9e-bafe-0df7ed96039f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:17.623015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7d3d0-957b-4bf4-9f8d-ceb6bbd5c3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:17.623651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d3d0-957b-4bf4-9f8d-ceb6bbd5c3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:17.623968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d3d0-957b-4bf4-9f8d-ceb6bbd5c3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:17.624246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d3d0-957b-4bf4-9f8d-ceb6bbd5c3f6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:17.625025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7d3d0-957b-4bf4-9f8d-ceb6bbd5c3f6 admin admin] RBAC: Adding query filter params (interface=public, service_id=79501cd5ee3d4edca785c1ba7aa4607c, region_id=RegionOne) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:17.625338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7d3d0-957b-4bf4-9f8d-ceb6bbd5c3f6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:17.626907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7d3d0-957b-4bf4-9f8d-ceb6bbd5c3f6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:17.631867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 601/1196] 10.222.0.16 () {56 vars in 1273 bytes} [Wed Jul 28 03:28:17 2021] GET /identity/v3/endpoints?service_id=79501cd5ee3d4edca785c1ba7aa4607c&interface=public®ion_id=RegionOne => generated 194 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:17.637540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:17.646827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035110fd-9c01-4129-9bbc-5c14e9c11c32 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:17.650986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f8ec-f7f5-4a04-a850-b54402dbc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:17.651612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f8ec-f7f5-4a04-a850-b54402dbc8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:17.651918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f8ec-f7f5-4a04-a850-b54402dbc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:17.652193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f8ec-f7f5-4a04-a850-b54402dbc8f7 admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:17.652851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f8ec-f7f5-4a04-a850-b54402dbc8f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:17.654395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f8ec-f7f5-4a04-a850-b54402dbc8f7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:17.661894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 596/1197] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:28:17 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:28:19.749212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e77d98-dbe1-410d-802e-82ff9befaec9 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:19.749758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e77d98-dbe1-410d-802e-82ff9befaec9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:19.749758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e77d98-dbe1-410d-802e-82ff9befaec9 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:19.751538 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 602/1198] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:28:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:28:19.758014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68893e-1b00-4fe8-80b3-2853521ebf8a None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:19.758413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68893e-1b00-4fe8-80b3-2853521ebf8a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:19.758570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68893e-1b00-4fe8-80b3-2853521ebf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:19.775929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-fd68893e-1b00-4fe8-80b3-2853521ebf8a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:28:19.777074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fd68893e-1b00-4fe8-80b3-2853521ebf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:28:19.784177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 597/1199] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:28:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:28:19.808315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e77d98-dbe1-410d-802e-82ff9befaec9 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:19.820630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e77d98-dbe1-410d-802e-82ff9befaec9 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:19.824728 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:19.825507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:19.825786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:19.826056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:19.826698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:19.828301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:19.838893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:28:19.840270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 603/1200] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 28 03:28:19 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:28:19.846536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68893e-1b00-4fe8-80b3-2853521ebf8a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:19.854670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68893e-1b00-4fe8-80b3-2853521ebf8a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:19.858871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6941be3-42a9-487c-a8ea-1b8cf36cdafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:19.859513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941be3-42a9-487c-a8ea-1b8cf36cdafa admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:19.859825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941be3-42a9-487c-a8ea-1b8cf36cdafa admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:19.860101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941be3-42a9-487c-a8ea-1b8cf36cdafa admin admin] PATH_INFO: `/v3/services` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:19.860800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6941be3-42a9-487c-a8ea-1b8cf36cdafa admin admin] RBAC: Adding query filter params (name=placement) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:28:19.861101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6941be3-42a9-487c-a8ea-1b8cf36cdafa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:19.863184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6941be3-42a9-487c-a8ea-1b8cf36cdafa admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:19.868226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 598/1201] 10.222.0.16 () {56 vars in 1138 bytes} [Wed Jul 28 03:28:19 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:28:19.874059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:28:19.884003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbbc8b-06f1-4ed7-b2e8-00825c4dce93 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:28:19.888273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce6c8d-eb76-4694-b9a7-3cb12c9a3a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:28:19.888900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6c8d-eb76-4694-b9a7-3cb12c9a3a0c admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:28:19.889185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6c8d-eb76-4694-b9a7-3cb12c9a3a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:28:19.889464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6c8d-eb76-4694-b9a7-3cb12c9a3a0c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:28:19.890195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce6c8d-eb76-4694-b9a7-3cb12c9a3a0c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:28:19.891887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce6c8d-eb76-4694-b9a7-3cb12c9a3a0c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:28:19.908762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 604/1202] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Jul 28 03:28:19 2021] POST /identity/v3/endpoints => generated 331 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:29:23.944368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256e51-6ff3-42d3-81a6-f4e70696c342 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:23.944839 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256e51-6ff3-42d3-81a6-f4e70696c342 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:23.945146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256e51-6ff3-42d3-81a6-f4e70696c342 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:23.948230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 599/1203] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:23.952626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66501-913e-48c8-b04e-83a8a1a0c5b0 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:23.953012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66501-913e-48c8-b04e-83a8a1a0c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:23.953213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66501-913e-48c8-b04e-83a8a1a0c5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:24.112433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ffe66501-913e-48c8-b04e-83a8a1a0c5b0 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:24.115911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ffe66501-913e-48c8-b04e-83a8a1a0c5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:24.254664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 605/1204] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:24.279281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256e51-6ff3-42d3-81a6-f4e70696c342 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:24.281171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-71256e51-6ff3-42d3-81a6-f4e70696c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:24.405006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256e51-6ff3-42d3-81a6-f4e70696c342 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:24.498350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060b304-2cfa-49a6-b646-5ae6e3688fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:24.499113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b304-2cfa-49a6-b646-5ae6e3688fea admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:24.499494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b304-2cfa-49a6-b646-5ae6e3688fea admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:24.499900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b304-2cfa-49a6-b646-5ae6e3688fea admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:24.500726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b304-2cfa-49a6-b646-5ae6e3688fea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:24.502733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b304-2cfa-49a6-b646-5ae6e3688fea admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:24.529699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 600/1205] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:29:24 2021] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:29:26.725051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961737c-0fd6-404b-9ced-9eae454b535e None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:26.725513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961737c-0fd6-404b-9ced-9eae454b535e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:26.725601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961737c-0fd6-404b-9ced-9eae454b535e None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:26.727380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 606/1206] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:26.733274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602008fc-ed02-4270-b285-16c640ee7379 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:26.733660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602008fc-ed02-4270-b285-16c640ee7379 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:26.733835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602008fc-ed02-4270-b285-16c640ee7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:26.803856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-602008fc-ed02-4270-b285-16c640ee7379 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:26.805043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-602008fc-ed02-4270-b285-16c640ee7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:26.897420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 601/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:26.948268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e059d-caf4-4732-9e71-8350acbc58d0 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:26.948483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e059d-caf4-4732-9e71-8350acbc58d0 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:26.948760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e059d-caf4-4732-9e71-8350acbc58d0 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:26.950541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 607/1208] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jul 28 03:29:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:26.957392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554d36-dfcc-406c-8a54-ca9b3e89c418 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:26.957627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554d36-dfcc-406c-8a54-ca9b3e89c418 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:26.957901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554d36-dfcc-406c-8a54-ca9b3e89c418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:27.030163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-34554d36-dfcc-406c-8a54-ca9b3e89c418 None None] MFA Rules not processed for user `78279cb4fa504d18943cd8807b674cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:27.031335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-34554d36-dfcc-406c-8a54-ca9b3e89c418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:27.102651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 602/1209] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Jul 28 03:29:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:29:27.112510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e059d-caf4-4732-9e71-8350acbc58d0 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:27.113990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b87e059d-caf4-4732-9e71-8350acbc58d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:27.215806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e059d-caf4-4732-9e71-8350acbc58d0 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:27.285718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b137-e263-4dc6-a43d-fd75f707552e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:27.286359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b137-e263-4dc6-a43d-fd75f707552e service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:27.286635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b137-e263-4dc6-a43d-fd75f707552e service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:27.286905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b137-e263-4dc6-a43d-fd75f707552e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:27.288530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6554b137-e263-4dc6-a43d-fd75f707552e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:27.393103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b137-e263-4dc6-a43d-fd75f707552e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:27.394555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b137-e263-4dc6-a43d-fd75f707552e service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:27.411952 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 608/1210] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:29:29.801071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16740677-b9e0-4a3d-b443-dd41c90df606 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:29.801601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16740677-b9e0-4a3d-b443-dd41c90df606 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:29.801601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16740677-b9e0-4a3d-b443-dd41c90df606 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:29.803387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 603/1211] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:29.809193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8039-93aa-4639-9765-5df208b039fc None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:29.809608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8039-93aa-4639-9765-5df208b039fc None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:29.809740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8039-93aa-4639-9765-5df208b039fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:29.876458 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-2dde8039-93aa-4639-9765-5df208b039fc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:29.877736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2dde8039-93aa-4639-9765-5df208b039fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:29.973212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 609/1212] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:29:30.012056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16740677-b9e0-4a3d-b443-dd41c90df606 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:30.013583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-16740677-b9e0-4a3d-b443-dd41c90df606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:30.111313 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16740677-b9e0-4a3d-b443-dd41c90df606 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:30.181261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00761a45-602d-402b-abdc-898b6a988ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:30.181916 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00761a45-602d-402b-abdc-898b6a988ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:30.182199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00761a45-602d-402b-abdc-898b6a988ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:30.182475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00761a45-602d-402b-abdc-898b6a988ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:30.184093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-00761a45-602d-402b-abdc-898b6a988ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:30.285857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00761a45-602d-402b-abdc-898b6a988ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:30.287288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00761a45-602d-402b-abdc-898b6a988ff5 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:30.305627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 604/1213] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:29:32.730333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4356d-a461-4218-bee7-f66fd7164932 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:32.730897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4356d-a461-4218-bee7-f66fd7164932 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:32.730897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4356d-a461-4218-bee7-f66fd7164932 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:32.732682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 610/1214] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:32.739226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b1abd-620d-4ee5-be2a-79c257553a67 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:32.739665 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b1abd-620d-4ee5-be2a-79c257553a67 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:32.739806 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b1abd-620d-4ee5-be2a-79c257553a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:32.800886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b52b1abd-620d-4ee5-be2a-79c257553a67 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:32.802071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b52b1abd-620d-4ee5-be2a-79c257553a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:32.892456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 605/1215] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:32.927858 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4356d-a461-4218-bee7-f66fd7164932 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:32.929329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-99a4356d-a461-4218-bee7-f66fd7164932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:33.047359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4356d-a461-4218-bee7-f66fd7164932 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:33.135073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842d2e6-a148-4e78-906a-fac76b275aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:33.135953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d2e6-a148-4e78-906a-fac76b275aec admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:33.136230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d2e6-a148-4e78-906a-fac76b275aec admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:33.136496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d2e6-a148-4e78-906a-fac76b275aec admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:33.146647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842d2e6-a148-4e78-906a-fac76b275aec admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:33.148818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842d2e6-a148-4e78-906a-fac76b275aec admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:33.150474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 611/1216] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:29:32 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:29:33.163462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b1abd-620d-4ee5-be2a-79c257553a67 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:33.164652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b52b1abd-620d-4ee5-be2a-79c257553a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:33.256224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b1abd-620d-4ee5-be2a-79c257553a67 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:33.325501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47744e2b-4dd2-4d9b-9356-f81690652309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:33.326074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744e2b-4dd2-4d9b-9356-f81690652309 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:33.326348 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744e2b-4dd2-4d9b-9356-f81690652309 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:33.326618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744e2b-4dd2-4d9b-9356-f81690652309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:33.328204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-47744e2b-4dd2-4d9b-9356-f81690652309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:33.430501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47744e2b-4dd2-4d9b-9356-f81690652309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:33.431955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47744e2b-4dd2-4d9b-9356-f81690652309 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:33.449325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 606/1217] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:29:36.121252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a1d63-6aca-4183-8452-9e7a346691b1 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:36.121814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a1d63-6aca-4183-8452-9e7a346691b1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:36.121814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a1d63-6aca-4183-8452-9e7a346691b1 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:36.123894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 612/1218] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:36.129539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676e90-4149-404b-b8e4-7c4c3f2de3ba None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:36.129981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676e90-4149-404b-b8e4-7c4c3f2de3ba None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:36.130133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676e90-4149-404b-b8e4-7c4c3f2de3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:36.192748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-e7676e90-4149-404b-b8e4-7c4c3f2de3ba None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:36.193919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e7676e90-4149-404b-b8e4-7c4c3f2de3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:36.284330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 607/1219] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:29:36.318353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a1d63-6aca-4183-8452-9e7a346691b1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:36.319831 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-cb1a1d63-6aca-4183-8452-9e7a346691b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:36.437021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a1d63-6aca-4183-8452-9e7a346691b1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:36.524802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867b29-bc3f-48ed-a979-e5c750ab39b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:36.525646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867b29-bc3f-48ed-a979-e5c750ab39b1 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:36.525926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867b29-bc3f-48ed-a979-e5c750ab39b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:36.526206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867b29-bc3f-48ed-a979-e5c750ab39b1 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:36.536033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867b29-bc3f-48ed-a979-e5c750ab39b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:36.538100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867b29-bc3f-48ed-a979-e5c750ab39b1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:36.539739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 613/1220] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:29:36 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:29:36.552029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7676e90-4149-404b-b8e4-7c4c3f2de3ba None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:36.553178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e7676e90-4149-404b-b8e4-7c4c3f2de3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:36.637077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7676e90-4149-404b-b8e4-7c4c3f2de3ba None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:36.706758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529626-6f02-4515-92af-206291b16283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:36.707357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529626-6f02-4515-92af-206291b16283 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:36.707639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529626-6f02-4515-92af-206291b16283 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:36.707945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529626-6f02-4515-92af-206291b16283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:36.709521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f7529626-6f02-4515-92af-206291b16283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:36.811513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7529626-6f02-4515-92af-206291b16283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:36.812985 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7529626-6f02-4515-92af-206291b16283 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:36.829672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 608/1221] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:29:39.618960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099a23-de62-40b5-be54-d0318c37c365 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:39.619484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099a23-de62-40b5-be54-d0318c37c365 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:39.619484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099a23-de62-40b5-be54-d0318c37c365 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:39.621312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 614/1222] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:39.628110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20760a5f-7172-4672-8a68-331404ab29bd None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:39.628533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20760a5f-7172-4672-8a68-331404ab29bd None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:39.628667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20760a5f-7172-4672-8a68-331404ab29bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:39.691078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-20760a5f-7172-4672-8a68-331404ab29bd None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:39.692268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-20760a5f-7172-4672-8a68-331404ab29bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:39.792125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 609/1223] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:39.829701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099a23-de62-40b5-be54-d0318c37c365 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:39.831176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-99099a23-de62-40b5-be54-d0318c37c365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:39.933148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099a23-de62-40b5-be54-d0318c37c365 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:40.003553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882820cb-497d-4adf-a6f1-fbf34bb591ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:40.004218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882820cb-497d-4adf-a6f1-fbf34bb591ec service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:40.004494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882820cb-497d-4adf-a6f1-fbf34bb591ec service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:40.004762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882820cb-497d-4adf-a6f1-fbf34bb591ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:40.006326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-882820cb-497d-4adf-a6f1-fbf34bb591ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:40.109985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882820cb-497d-4adf-a6f1-fbf34bb591ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:40.111945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882820cb-497d-4adf-a6f1-fbf34bb591ec service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:40.129516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 615/1224] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:29:42.328332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be432f-8615-4885-bc06-de697b553e1f None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:42.329409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be432f-8615-4885-bc06-de697b553e1f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:42.329409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be432f-8615-4885-bc06-de697b553e1f None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:42.331224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 610/1225] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:42.337364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af6a08-cd6f-42c4-b557-bc3b46f43c92 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:42.337803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af6a08-cd6f-42c4-b557-bc3b46f43c92 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:42.338047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af6a08-cd6f-42c4-b557-bc3b46f43c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:42.400915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b1af6a08-cd6f-42c4-b557-bc3b46f43c92 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:42.401969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b1af6a08-cd6f-42c4-b557-bc3b46f43c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:42.493803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 616/1226] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:42.529874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be432f-8615-4885-bc06-de697b553e1f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:42.531355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a5be432f-8615-4885-bc06-de697b553e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:42.629116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be432f-8615-4885-bc06-de697b553e1f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:42.698890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e780fe-e000-42ca-8bde-e7a9361f0ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:42.699464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e780fe-e000-42ca-8bde-e7a9361f0ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:42.699773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e780fe-e000-42ca-8bde-e7a9361f0ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:42.700050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e780fe-e000-42ca-8bde-e7a9361f0ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:42.701628 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-95e780fe-e000-42ca-8bde-e7a9361f0ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:42.807112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e780fe-e000-42ca-8bde-e7a9361f0ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:42.808639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e780fe-e000-42ca-8bde-e7a9361f0ca2 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:42.828227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 611/1227] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:29:45.026605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe266c5-d3c6-417b-bc6c-1b6bcc216f52 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:45.027187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe266c5-d3c6-417b-bc6c-1b6bcc216f52 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:45.027187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe266c5-d3c6-417b-bc6c-1b6bcc216f52 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:45.029314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 617/1228] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:45.035722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc599f9-15e5-46d7-adbb-a074e2bfcd56 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:45.036213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc599f9-15e5-46d7-adbb-a074e2bfcd56 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:45.036324 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc599f9-15e5-46d7-adbb-a074e2bfcd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:45.104112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3bc599f9-15e5-46d7-adbb-a074e2bfcd56 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:45.105264 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3bc599f9-15e5-46d7-adbb-a074e2bfcd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:45.196461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 612/1229] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:45.229930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe266c5-d3c6-417b-bc6c-1b6bcc216f52 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:45.231338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-dfe266c5-d3c6-417b-bc6c-1b6bcc216f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:45.355510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe266c5-d3c6-417b-bc6c-1b6bcc216f52 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:45.444660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c5593-5063-4165-84e1-f048b1a069cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:45.445537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5593-5063-4165-84e1-f048b1a069cc admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:45.445820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5593-5063-4165-84e1-f048b1a069cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:45.446102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5593-5063-4165-84e1-f048b1a069cc admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:45.455480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c5593-5063-4165-84e1-f048b1a069cc admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:45.457631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c5593-5063-4165-84e1-f048b1a069cc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:45.459293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 618/1230] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:29:45 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:29:45.488669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d46e2-53ed-4643-9892-b26ba9266c6e None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:45.488885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d46e2-53ed-4643-9892-b26ba9266c6e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:45.489164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d46e2-53ed-4643-9892-b26ba9266c6e None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:45.490973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 613/1231] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jul 28 03:29:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:45.497324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0b33-a4e7-4871-b30a-8e234c4a19ea None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:45.497607 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0b33-a4e7-4871-b30a-8e234c4a19ea None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:45.497880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0b33-a4e7-4871-b30a-8e234c4a19ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:45.570401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ecac0b33-a4e7-4871-b30a-8e234c4a19ea None None] MFA Rules not processed for user `78279cb4fa504d18943cd8807b674cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:45.571565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ecac0b33-a4e7-4871-b30a-8e234c4a19ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:45.645216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 619/1232] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Jul 28 03:29:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:45.654450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d46e2-53ed-4643-9892-b26ba9266c6e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:45.656049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7c3d46e2-53ed-4643-9892-b26ba9266c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:45.756833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d46e2-53ed-4643-9892-b26ba9266c6e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:45.838485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55947a77-3e34-4d6a-9b08-27cbc62ace3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:45.839140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55947a77-3e34-4d6a-9b08-27cbc62ace3c service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:45.839418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55947a77-3e34-4d6a-9b08-27cbc62ace3c service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:45.839687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55947a77-3e34-4d6a-9b08-27cbc62ace3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:45.841577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-55947a77-3e34-4d6a-9b08-27cbc62ace3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:45.947729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55947a77-3e34-4d6a-9b08-27cbc62ace3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:45.949180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55947a77-3e34-4d6a-9b08-27cbc62ace3c service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:45.966728 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 614/1233] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:29:48.737827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67f00-94db-4efd-9766-e744ff2ad3d6 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:48.738366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67f00-94db-4efd-9766-e744ff2ad3d6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:48.738518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67f00-94db-4efd-9766-e744ff2ad3d6 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:48.740325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 620/1234] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:29:48.746380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507da3-6806-470e-93cf-bd41bc2986f6 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:48.746818 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507da3-6806-470e-93cf-bd41bc2986f6 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:48.746912 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507da3-6806-470e-93cf-bd41bc2986f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:48.807929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-05507da3-6806-470e-93cf-bd41bc2986f6 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:48.809075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-05507da3-6806-470e-93cf-bd41bc2986f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:48.899729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 615/1235] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:48.936131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e67f00-94db-4efd-9766-e744ff2ad3d6 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:48.937632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d7e67f00-94db-4efd-9766-e744ff2ad3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:49.037496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e67f00-94db-4efd-9766-e744ff2ad3d6 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:49.111048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cfe84-0c49-4a44-8c44-2a1a4f28f246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:49.111690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfe84-0c49-4a44-8c44-2a1a4f28f246 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:49.112068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfe84-0c49-4a44-8c44-2a1a4f28f246 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:49.112342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfe84-0c49-4a44-8c44-2a1a4f28f246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:49.113918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f40cfe84-0c49-4a44-8c44-2a1a4f28f246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:49.232354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cfe84-0c49-4a44-8c44-2a1a4f28f246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:49.233810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cfe84-0c49-4a44-8c44-2a1a4f28f246 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:49.251605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 621/1236] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:29:51.459503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c316c-7595-4734-ba9f-4ed3deb564ef None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:51.460047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c316c-7595-4734-ba9f-4ed3deb564ef None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:51.460047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c316c-7595-4734-ba9f-4ed3deb564ef None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:51.461772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 616/1237] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:51.467973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d6e1-e540-4cd3-b482-8e169dcc3b80 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:51.468339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d6e1-e540-4cd3-b482-8e169dcc3b80 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:51.468556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d6e1-e540-4cd3-b482-8e169dcc3b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:51.530645 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d165d6e1-e540-4cd3-b482-8e169dcc3b80 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:51.531865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d165d6e1-e540-4cd3-b482-8e169dcc3b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:51.622346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 622/1238] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:51.663220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c316c-7595-4734-ba9f-4ed3deb564ef None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:51.664742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-260c316c-7595-4734-ba9f-4ed3deb564ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:51.761372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c316c-7595-4734-ba9f-4ed3deb564ef None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:51.831171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8866c2f-23e4-4601-8d28-450ccb6ce3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:51.831840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866c2f-23e4-4601-8d28-450ccb6ce3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:51.832121 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866c2f-23e4-4601-8d28-450ccb6ce3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:51.832391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866c2f-23e4-4601-8d28-450ccb6ce3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:51.833951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d8866c2f-23e4-4601-8d28-450ccb6ce3a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:51.936580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8866c2f-23e4-4601-8d28-450ccb6ce3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:51.938027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8866c2f-23e4-4601-8d28-450ccb6ce3a0 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:51.954660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 617/1239] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:29:54.418625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793fea1-c985-42c9-a2e7-5dd9f0d76284 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:54.419168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793fea1-c985-42c9-a2e7-5dd9f0d76284 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:54.419168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793fea1-c985-42c9-a2e7-5dd9f0d76284 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:54.420900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 623/1240] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:54.427896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84c74b-b40d-40b3-91ab-0d256cb8cfdc None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:54.428290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84c74b-b40d-40b3-91ab-0d256cb8cfdc None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:54.428448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84c74b-b40d-40b3-91ab-0d256cb8cfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:54.494844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0b84c74b-b40d-40b3-91ab-0d256cb8cfdc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:54.496025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0b84c74b-b40d-40b3-91ab-0d256cb8cfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:54.592825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 618/1241] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:54.630466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793fea1-c985-42c9-a2e7-5dd9f0d76284 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:54.632549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a793fea1-c985-42c9-a2e7-5dd9f0d76284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:54.721022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793fea1-c985-42c9-a2e7-5dd9f0d76284 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:54.724258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee943e1-b074-455a-ba99-705c678b2d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:54.724886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee943e1-b074-455a-ba99-705c678b2d76 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:54.725232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee943e1-b074-455a-ba99-705c678b2d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:54.725507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee943e1-b074-455a-ba99-705c678b2d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:54.733687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee943e1-b074-455a-ba99-705c678b2d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:54.735841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee943e1-b074-455a-ba99-705c678b2d76 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:54.744273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 624/1242] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:29:58.851228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5991-c132-48c1-aba5-4a1df938a47a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:58.851785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5991-c132-48c1-aba5-4a1df938a47a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:58.851785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5991-c132-48c1-aba5-4a1df938a47a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:58.853573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 619/1243] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:29:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:29:58.859541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec5e4-c7b8-4110-b89b-19fc2d2aa305 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:58.860613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec5e4-c7b8-4110-b89b-19fc2d2aa305 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:58.860765 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec5e4-c7b8-4110-b89b-19fc2d2aa305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:58.878232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6f4ec5e4-c7b8-4110-b89b-19fc2d2aa305 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:29:58.879339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6f4ec5e4-c7b8-4110-b89b-19fc2d2aa305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:29:58.886896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 625/1244] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:29:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:29:58.927614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a5991-c132-48c1-aba5-4a1df938a47a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:29:58.937585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a5991-c132-48c1-aba5-4a1df938a47a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:29:58.941934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c8a18-9ee0-4d3d-b754-ab913aee57fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:29:58.942559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8a18-9ee0-4d3d-b754-ab913aee57fe service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:29:58.942836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8a18-9ee0-4d3d-b754-ab913aee57fe service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:29:58.943107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8a18-9ee0-4d3d-b754-ab913aee57fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:29:58.951408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c8a18-9ee0-4d3d-b754-ab913aee57fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:29:58.952811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c8a18-9ee0-4d3d-b754-ab913aee57fe service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:29:58.961953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 620/1245] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:29:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:01.724563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f498f0-cc80-4900-9774-0189d2671475 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:01.725119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f498f0-cc80-4900-9774-0189d2671475 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:01.725119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f498f0-cc80-4900-9774-0189d2671475 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:01.727057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 626/1246] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:01.732686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4829-f44f-4745-a8a1-57dd4ca81dad None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:01.733119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4829-f44f-4745-a8a1-57dd4ca81dad None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:01.733369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4829-f44f-4745-a8a1-57dd4ca81dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:01.751252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0a0c4829-f44f-4745-a8a1-57dd4ca81dad None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:01.752417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0a0c4829-f44f-4745-a8a1-57dd4ca81dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:01.759577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 621/1247] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:30:01.798268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f498f0-cc80-4900-9774-0189d2671475 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:01.808368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f498f0-cc80-4900-9774-0189d2671475 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:01.811778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad1b1-a644-4fe0-b3db-3319d6873eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:01.812480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad1b1-a644-4fe0-b3db-3319d6873eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:01.813268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad1b1-a644-4fe0-b3db-3319d6873eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:01.813624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad1b1-a644-4fe0-b3db-3319d6873eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:01.821881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad1b1-a644-4fe0-b3db-3319d6873eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:01.823306 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad1b1-a644-4fe0-b3db-3319d6873eb2 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:01.832688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 627/1248] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:05.963208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965758-6cd8-4460-898b-7523cc9c4a7e None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:05.963735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965758-6cd8-4460-898b-7523cc9c4a7e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:05.963844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965758-6cd8-4460-898b-7523cc9c4a7e None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:05.965804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 622/1249] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:05.972002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5c18-7391-42dd-8525-3ec0e6395898 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:05.972425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5c18-7391-42dd-8525-3ec0e6395898 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:05.972579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5c18-7391-42dd-8525-3ec0e6395898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:05.990037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-51bc5c18-7391-42dd-8525-3ec0e6395898 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:05.991205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-51bc5c18-7391-42dd-8525-3ec0e6395898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:05.998528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 628/1250] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:30:06.038126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d965758-6cd8-4460-898b-7523cc9c4a7e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:06.048152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d965758-6cd8-4460-898b-7523cc9c4a7e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:06.051806 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892485b-adc9-4301-aad1-d29c420a1f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:06.052447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892485b-adc9-4301-aad1-d29c420a1f4b service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:06.052734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892485b-adc9-4301-aad1-d29c420a1f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:06.053021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892485b-adc9-4301-aad1-d29c420a1f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:06.062026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892485b-adc9-4301-aad1-d29c420a1f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:06.064138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892485b-adc9-4301-aad1-d29c420a1f4b service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:06.073356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 623/1251] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:30:11.098367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f883-f2b1-4b00-bcb5-44f661ac03ac None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:11.098913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f883-f2b1-4b00-bcb5-44f661ac03ac None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:11.098913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f883-f2b1-4b00-bcb5-44f661ac03ac None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:11.101067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 629/1252] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:30:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:11.108775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad13ae-0e4f-4127-bf15-16ca5b37185c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:11.110289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad13ae-0e4f-4127-bf15-16ca5b37185c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:11.110730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad13ae-0e4f-4127-bf15-16ca5b37185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:11.190170 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-4aad13ae-0e4f-4127-bf15-16ca5b37185c None None] MFA Rules not processed for user `d2b5335392b4400d94f1dfce0e010b74`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:11.191337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4aad13ae-0e4f-4127-bf15-16ca5b37185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:11.290747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 624/1253] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:30:11 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:11.515313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1db6e-c760-4fec-adf1-cd130fc2cb61 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:11.516578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1db6e-c760-4fec-adf1-cd130fc2cb61 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:11.517139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1db6e-c760-4fec-adf1-cd130fc2cb61 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:11.519076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 630/1254] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:30:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:30:11.524382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460cce-d150-46e9-b876-17faeaf1ae69 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:11.524880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460cce-d150-46e9-b876-17faeaf1ae69 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:11.525315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460cce-d150-46e9-b876-17faeaf1ae69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:11.561714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d0460cce-d150-46e9-b876-17faeaf1ae69 None None] MFA Rules not processed for user `d2b5335392b4400d94f1dfce0e010b74`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:11.567336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d0460cce-d150-46e9-b876-17faeaf1ae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:11.575790 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 625/1255] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:30:11 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:16.149974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6a55-056e-4e53-903f-0800064d10c6 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:16.150506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6a55-056e-4e53-903f-0800064d10c6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:16.150506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6a55-056e-4e53-903f-0800064d10c6 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:16.152325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 631/1256] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:30:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:16.159472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945676f0-22a2-4264-8281-be6d60f33f0f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:16.159938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945676f0-22a2-4264-8281-be6d60f33f0f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:16.160176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945676f0-22a2-4264-8281-be6d60f33f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:16.180948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-945676f0-22a2-4264-8281-be6d60f33f0f None None] MFA Rules not processed for user `d2b5335392b4400d94f1dfce0e010b74`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:16.182107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-945676f0-22a2-4264-8281-be6d60f33f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:16.191248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 626/1257] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:30:16 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:17.813782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14864ca5-5e1f-4d28-90b5-dc4530e2e509 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:17.814301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14864ca5-5e1f-4d28-90b5-dc4530e2e509 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:17.814407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14864ca5-5e1f-4d28-90b5-dc4530e2e509 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:17.816122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 632/1258] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:30:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:17.821216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3cec8-a70c-4ed6-9577-f2c758a6fdd2 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:17.821645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3cec8-a70c-4ed6-9577-f2c758a6fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:17.821789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3cec8-a70c-4ed6-9577-f2c758a6fdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:17.839476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f3a3cec8-a70c-4ed6-9577-f2c758a6fdd2 None None] MFA Rules not processed for user `d2b5335392b4400d94f1dfce0e010b74`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:17.841014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f3a3cec8-a70c-4ed6-9577-f2c758a6fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:17.849381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 627/1259] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:30:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:30:21.398289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99220-893f-4800-a668-8f0bc7e911ef None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:21.398797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99220-893f-4800-a668-8f0bc7e911ef None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:21.398797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99220-893f-4800-a668-8f0bc7e911ef None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:21.400544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 633/1260] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:21.406770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197983a1-71b5-49d4-b383-b269835b1db3 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:21.407228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197983a1-71b5-49d4-b383-b269835b1db3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:21.407500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197983a1-71b5-49d4-b383-b269835b1db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:21.427446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-197983a1-71b5-49d4-b383-b269835b1db3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:21.428641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-197983a1-71b5-49d4-b383-b269835b1db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:21.436234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 628/1261] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:21.486750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1af62-92ec-49f5-a67b-d626c87ef6da None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:21.487104 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1af62-92ec-49f5-a67b-d626c87ef6da None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:21.487286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1af62-92ec-49f5-a67b-d626c87ef6da None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:21.489205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 634/1262] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 28 03:30:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:21.496423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa928f4-827b-4283-9e9a-cea9d1dda32f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:21.496793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa928f4-827b-4283-9e9a-cea9d1dda32f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:21.497276 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa928f4-827b-4283-9e9a-cea9d1dda32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:21.544875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-cfa928f4-827b-4283-9e9a-cea9d1dda32f None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:21.546079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cfa928f4-827b-4283-9e9a-cea9d1dda32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:21.624648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 629/1263] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 28 03:30:21 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:21.633480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1af62-92ec-49f5-a67b-d626c87ef6da None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:21.646547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1af62-92ec-49f5-a67b-d626c87ef6da None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:21.651523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615a24a-4da0-4eb8-87db-0ce452f4ff6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:21.652124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a24a-4da0-4eb8-87db-0ce452f4ff6c service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:21.652403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a24a-4da0-4eb8-87db-0ce452f4ff6c service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:21.652674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a24a-4da0-4eb8-87db-0ce452f4ff6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:21.660414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615a24a-4da0-4eb8-87db-0ce452f4ff6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:21.661984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615a24a-4da0-4eb8-87db-0ce452f4ff6c service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:21.670638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 635/1264] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:24.059339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a094b9-e7f9-45eb-b9b9-47a609b8d849 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:24.060258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a094b9-e7f9-45eb-b9b9-47a609b8d849 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:24.060710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a094b9-e7f9-45eb-b9b9-47a609b8d849 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:24.062560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 630/1265] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:24.068948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3c57-d579-4d88-a15b-30b14b342506 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:24.069405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3c57-d579-4d88-a15b-30b14b342506 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:24.069541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3c57-d579-4d88-a15b-30b14b342506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:24.089215 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f3ae3c57-d579-4d88-a15b-30b14b342506 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:24.091358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f3ae3c57-d579-4d88-a15b-30b14b342506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:24.099654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 636/1266] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:24.146529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a094b9-e7f9-45eb-b9b9-47a609b8d849 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:24.166382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a094b9-e7f9-45eb-b9b9-47a609b8d849 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:24.173479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee533b7-8ebd-4605-84a5-acc863bfb1aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:24.174931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee533b7-8ebd-4605-84a5-acc863bfb1aa service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:24.175427 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee533b7-8ebd-4605-84a5-acc863bfb1aa service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:24.175930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee533b7-8ebd-4605-84a5-acc863bfb1aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:24.187026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee533b7-8ebd-4605-84a5-acc863bfb1aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:24.189466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee533b7-8ebd-4605-84a5-acc863bfb1aa service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:24.200319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 631/1267] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:26.697781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74306813-d046-42d3-b70b-3dfd9d2a0b56 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:26.698296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74306813-d046-42d3-b70b-3dfd9d2a0b56 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:26.698387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74306813-d046-42d3-b70b-3dfd9d2a0b56 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:26.700141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 637/1268] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:26.706234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322dff3-5759-4be7-85d5-8dabecb6bce6 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:26.706649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322dff3-5759-4be7-85d5-8dabecb6bce6 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:26.706851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322dff3-5759-4be7-85d5-8dabecb6bce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:26.731739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8322dff3-5759-4be7-85d5-8dabecb6bce6 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:26.731739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8322dff3-5759-4be7-85d5-8dabecb6bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:26.744102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 632/1269] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:26.792131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d001-2633-492b-a0d9-d35ec69865a3 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:26.792422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d001-2633-492b-a0d9-d35ec69865a3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:26.792700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d001-2633-492b-a0d9-d35ec69865a3 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:26.794452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 638/1270] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 28 03:30:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:26.800767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07715-63ff-4746-a814-e5ad0fa9ebf7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:26.801060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07715-63ff-4746-a814-e5ad0fa9ebf7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:26.801340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07715-63ff-4746-a814-e5ad0fa9ebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:26.819468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-cfd07715-63ff-4746-a814-e5ad0fa9ebf7 None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:26.820650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cfd07715-63ff-4746-a814-e5ad0fa9ebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:26.829931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 633/1271] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 28 03:30:26 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:30:26.838201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089d001-2633-492b-a0d9-d35ec69865a3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:26.851811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089d001-2633-492b-a0d9-d35ec69865a3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:26.856731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6c50-70bb-4099-be27-e230ec3ff510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:26.857355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6c50-70bb-4099-be27-e230ec3ff510 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:26.857625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6c50-70bb-4099-be27-e230ec3ff510 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:26.857902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6c50-70bb-4099-be27-e230ec3ff510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:26.866221 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6c50-70bb-4099-be27-e230ec3ff510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:26.867815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6c50-70bb-4099-be27-e230ec3ff510 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:26.877290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 639/1272] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:29.113680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6634-ecf1-426f-9bf5-826fcd90be15 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:29.114248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6634-ecf1-426f-9bf5-826fcd90be15 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:29.114248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6634-ecf1-426f-9bf5-826fcd90be15 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:29.116307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 634/1273] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:29.123642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad331d-7162-4ffc-86c7-a96a14643945 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:29.124111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad331d-7162-4ffc-86c7-a96a14643945 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:29.124216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad331d-7162-4ffc-86c7-a96a14643945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:29.142458 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ccad331d-7162-4ffc-86c7-a96a14643945 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:29.143602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ccad331d-7162-4ffc-86c7-a96a14643945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:29.151273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 640/1274] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:29.198656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6634-ecf1-426f-9bf5-826fcd90be15 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:29.212178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6634-ecf1-426f-9bf5-826fcd90be15 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:29.217517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b305a6-8686-4bde-9674-a65c68d5a376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:29.219003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b305a6-8686-4bde-9674-a65c68d5a376 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:29.219098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b305a6-8686-4bde-9674-a65c68d5a376 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:29.219527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b305a6-8686-4bde-9674-a65c68d5a376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:29.228702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b305a6-8686-4bde-9674-a65c68d5a376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:29.230480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b305a6-8686-4bde-9674-a65c68d5a376 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:29.240844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 635/1275] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:29.833213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e557-23a3-46cb-9567-9498335b2410 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:29.833617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e557-23a3-46cb-9567-9498335b2410 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:29.833799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e557-23a3-46cb-9567-9498335b2410 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:29.835624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 641/1276] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:29.841735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a39334-6d92-455d-95eb-630761bb558d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:29.842025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a39334-6d92-455d-95eb-630761bb558d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:29.842301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a39334-6d92-455d-95eb-630761bb558d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:29.860325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d5a39334-6d92-455d-95eb-630761bb558d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:29.861479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d5a39334-6d92-455d-95eb-630761bb558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:29.868850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 636/1277] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:29.929418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462627d9-a121-4997-a7c0-13cdd698e0f2 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:29.929793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462627d9-a121-4997-a7c0-13cdd698e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:29.930151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462627d9-a121-4997-a7c0-13cdd698e0f2 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:29.932035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 642/1278] 10.222.0.16 () {54 vars in 963 bytes} [Wed Jul 28 03:30:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:29.938605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222c70-b2d3-41d7-90d0-c1499f767654 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:29.938893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222c70-b2d3-41d7-90d0-c1499f767654 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:29.939171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222c70-b2d3-41d7-90d0-c1499f767654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:29.988159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-55222c70-b2d3-41d7-90d0-c1499f767654 None None] MFA Rules not processed for user `a02f0a6cbe5442da8bd2f78643d31aba`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:29.989354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-55222c70-b2d3-41d7-90d0-c1499f767654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:30.052087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 637/1279] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jul 28 03:30:29 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:30:30.063394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462627d9-a121-4997-a7c0-13cdd698e0f2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:30.076892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462627d9-a121-4997-a7c0-13cdd698e0f2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:30.082521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f3eb8-e8b1-49bb-9f43-0d7d314f7890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:30.083604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f3eb8-e8b1-49bb-9f43-0d7d314f7890 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:30.084067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f3eb8-e8b1-49bb-9f43-0d7d314f7890 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:30.084513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f3eb8-e8b1-49bb-9f43-0d7d314f7890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:30.096996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f3eb8-e8b1-49bb-9f43-0d7d314f7890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:30.098845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f3eb8-e8b1-49bb-9f43-0d7d314f7890 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:30.108150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 643/1280] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:31.473073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6a54-6af7-4f0a-8f99-12ae2b879a25 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:31.473507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6a54-6af7-4f0a-8f99-12ae2b879a25 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:31.473806 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6a54-6af7-4f0a-8f99-12ae2b879a25 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:31.475449 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 638/1281] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:31.482792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95fd0e-27b6-48b5-a01a-e1f641a73f91 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:31.483171 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95fd0e-27b6-48b5-a01a-e1f641a73f91 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:31.483393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95fd0e-27b6-48b5-a01a-e1f641a73f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:31.519174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-dc95fd0e-27b6-48b5-a01a-e1f641a73f91 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:31.521426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-dc95fd0e-27b6-48b5-a01a-e1f641a73f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:31.540596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 644/1282] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:31.594732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b6a54-6af7-4f0a-8f99-12ae2b879a25 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:31.623280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b6a54-6af7-4f0a-8f99-12ae2b879a25 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:31.631867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bc4f0-2d6f-42c6-b7de-d2ea0f4c806b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:31.632848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc4f0-2d6f-42c6-b7de-d2ea0f4c806b service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:31.633333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc4f0-2d6f-42c6-b7de-d2ea0f4c806b service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:31.634076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc4f0-2d6f-42c6-b7de-d2ea0f4c806b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:31.646518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bc4f0-2d6f-42c6-b7de-d2ea0f4c806b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:31.646785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bc4f0-2d6f-42c6-b7de-d2ea0f4c806b service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:31.662700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 639/1283] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:33.952042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0aba-e50d-4475-93d0-c8553d65b035 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:33.952586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0aba-e50d-4475-93d0-c8553d65b035 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:33.952671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0aba-e50d-4475-93d0-c8553d65b035 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:33.954673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 645/1284] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:33.960676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb93bb5-031f-44d0-b5dd-347684e72cf3 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:33.961656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb93bb5-031f-44d0-b5dd-347684e72cf3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:33.962087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb93bb5-031f-44d0-b5dd-347684e72cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:33.985475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5cb93bb5-031f-44d0-b5dd-347684e72cf3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:33.986887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5cb93bb5-031f-44d0-b5dd-347684e72cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:33.999076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 640/1285] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:34.047482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0aba-e50d-4475-93d0-c8553d65b035 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:34.074758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0aba-e50d-4475-93d0-c8553d65b035 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:34.081162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869d050-5a68-4237-9d16-27c4a532375f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:34.082020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869d050-5a68-4237-9d16-27c4a532375f service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:34.082634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869d050-5a68-4237-9d16-27c4a532375f service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:34.083194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869d050-5a68-4237-9d16-27c4a532375f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:34.093410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869d050-5a68-4237-9d16-27c4a532375f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:34.095378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869d050-5a68-4237-9d16-27c4a532375f service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:34.118020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 646/1286] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:36.389435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39d47-d746-4fc5-9adb-dbe90fec761e None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:36.392438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39d47-d746-4fc5-9adb-dbe90fec761e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:36.392438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39d47-d746-4fc5-9adb-dbe90fec761e None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:36.394087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 641/1287] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:36.399126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732592-365f-4a81-a3ff-9219905770f4 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:36.399584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732592-365f-4a81-a3ff-9219905770f4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:36.399666 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732592-365f-4a81-a3ff-9219905770f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:36.421033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-15732592-365f-4a81-a3ff-9219905770f4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:36.423211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-15732592-365f-4a81-a3ff-9219905770f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:36.432068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 647/1288] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:36.476767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab39d47-d746-4fc5-9adb-dbe90fec761e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:36.491971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab39d47-d746-4fc5-9adb-dbe90fec761e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:36.497688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff584d-b3be-4a02-8ccc-9c6b8417252e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:36.498729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff584d-b3be-4a02-8ccc-9c6b8417252e service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:36.499210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff584d-b3be-4a02-8ccc-9c6b8417252e service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:36.502182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff584d-b3be-4a02-8ccc-9c6b8417252e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:36.512038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff584d-b3be-4a02-8ccc-9c6b8417252e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:36.514042 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff584d-b3be-4a02-8ccc-9c6b8417252e service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:36.525975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 642/1289] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:38.787752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0092-f540-4039-9c8c-0c0cf42c1ad3 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:38.787752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0092-f540-4039-9c8c-0c0cf42c1ad3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:38.787752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0092-f540-4039-9c8c-0c0cf42c1ad3 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:38.788790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 648/1290] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:38.794867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e6c1-d513-4340-ae92-cb1195ccd8df None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:38.795318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e6c1-d513-4340-ae92-cb1195ccd8df None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:38.795413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e6c1-d513-4340-ae92-cb1195ccd8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:38.813524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8946e6c1-d513-4340-ae92-cb1195ccd8df None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:38.814692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8946e6c1-d513-4340-ae92-cb1195ccd8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:38.821942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 643/1291] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:38.868625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e0092-f540-4039-9c8c-0c0cf42c1ad3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:38.881737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e0092-f540-4039-9c8c-0c0cf42c1ad3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:38.886743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d97820-608a-42b4-a2ce-e3b9a427389c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:38.888064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97820-608a-42b4-a2ce-e3b9a427389c service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:38.888344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97820-608a-42b4-a2ce-e3b9a427389c service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:38.888613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97820-608a-42b4-a2ce-e3b9a427389c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:38.897901 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d97820-608a-42b4-a2ce-e3b9a427389c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:38.899517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d97820-608a-42b4-a2ce-e3b9a427389c service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:38.910298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 649/1292] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:41.731325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85761-501e-4488-983d-901e9290ead2 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:41.731988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85761-501e-4488-983d-901e9290ead2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:41.731988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85761-501e-4488-983d-901e9290ead2 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:41.734294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 644/1293] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:41.740813 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178137-4f42-44fc-a775-550f1ac065f4 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:41.741261 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178137-4f42-44fc-a775-550f1ac065f4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:41.741573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178137-4f42-44fc-a775-550f1ac065f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:41.764012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-eb178137-4f42-44fc-a775-550f1ac065f4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:41.766085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-eb178137-4f42-44fc-a775-550f1ac065f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:41.775429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 650/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:41.822727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85761-501e-4488-983d-901e9290ead2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:41.835909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85761-501e-4488-983d-901e9290ead2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:41.841228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5575-a24a-47ef-8492-10dde5825181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:41.841858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5575-a24a-47ef-8492-10dde5825181 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:41.842138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5575-a24a-47ef-8492-10dde5825181 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:41.842408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5575-a24a-47ef-8492-10dde5825181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:41.850144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac5575-a24a-47ef-8492-10dde5825181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:41.851743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac5575-a24a-47ef-8492-10dde5825181 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:41.861082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 645/1295] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:44.283628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e7e2-a1f1-449f-99eb-4708415307c3 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:44.284267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e7e2-a1f1-449f-99eb-4708415307c3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:44.284267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e7e2-a1f1-449f-99eb-4708415307c3 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:44.286042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 651/1296] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:44.292188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda62b9-f108-47bc-a6d6-7ccb5e4fe7f5 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:44.292605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda62b9-f108-47bc-a6d6-7ccb5e4fe7f5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:44.292750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda62b9-f108-47bc-a6d6-7ccb5e4fe7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:44.310490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6cda62b9-f108-47bc-a6d6-7ccb5e4fe7f5 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:44.311638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6cda62b9-f108-47bc-a6d6-7ccb5e4fe7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:44.318957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 646/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:44.365535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71e7e2-a1f1-449f-99eb-4708415307c3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:44.378961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71e7e2-a1f1-449f-99eb-4708415307c3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:44.384073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec603c-86c8-449a-97c4-b45f8a76ad42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:44.384855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec603c-86c8-449a-97c4-b45f8a76ad42 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:44.385137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec603c-86c8-449a-97c4-b45f8a76ad42 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:44.385414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec603c-86c8-449a-97c4-b45f8a76ad42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:44.393177 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec603c-86c8-449a-97c4-b45f8a76ad42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:44.394792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec603c-86c8-449a-97c4-b45f8a76ad42 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:44.403419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 652/1298] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:45.448913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896713-a1ac-4fbd-a251-47f61f540f43 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:45.449500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896713-a1ac-4fbd-a251-47f61f540f43 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:45.449500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896713-a1ac-4fbd-a251-47f61f540f43 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:45.451232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 647/1299] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:45.457658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e82447-02d1-4c01-9cc4-c5b01c75d125 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:45.458073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e82447-02d1-4c01-9cc4-c5b01c75d125 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:45.458212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e82447-02d1-4c01-9cc4-c5b01c75d125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:45.476605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-87e82447-02d1-4c01-9cc4-c5b01c75d125 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:45.477748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-87e82447-02d1-4c01-9cc4-c5b01c75d125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:45.486121 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 653/1300] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:45.542994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a23313-e46d-4acd-9211-0d950f181571 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:45.543315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a23313-e46d-4acd-9211-0d950f181571 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:45.543590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a23313-e46d-4acd-9211-0d950f181571 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:45.545384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 648/1301] 10.222.0.16 () {54 vars in 966 bytes} [Wed Jul 28 03:30:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:45.551271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d780961-33bf-4cc5-8bfa-ad89323a1c32 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:45.551633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d780961-33bf-4cc5-8bfa-ad89323a1c32 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:45.552021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d780961-33bf-4cc5-8bfa-ad89323a1c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:45.599354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3d780961-33bf-4cc5-8bfa-ad89323a1c32 None None] MFA Rules not processed for user `b8eb54ff54264f309aa5949ed8aef453`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:45.600551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3d780961-33bf-4cc5-8bfa-ad89323a1c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:45.660017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 654/1302] 10.222.0.16 () {58 vars in 1064 bytes} [Wed Jul 28 03:30:45 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:30:45.667596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a23313-e46d-4acd-9211-0d950f181571 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:45.678244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a23313-e46d-4acd-9211-0d950f181571 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:45.681662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10482c1e-ba09-42bb-b168-62080cbd0e6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:45.682384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10482c1e-ba09-42bb-b168-62080cbd0e6c service glance] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:45.682715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10482c1e-ba09-42bb-b168-62080cbd0e6c service glance] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:45.683055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10482c1e-ba09-42bb-b168-62080cbd0e6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:45.691901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10482c1e-ba09-42bb-b168-62080cbd0e6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:45.693331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10482c1e-ba09-42bb-b168-62080cbd0e6c service glance] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:45.701906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 649/1303] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:46.145357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd36cf-1072-4b37-9b5b-3b66bf36c812 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:46.145644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd36cf-1072-4b37-9b5b-3b66bf36c812 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:46.145922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd36cf-1072-4b37-9b5b-3b66bf36c812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:46.193622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3abd36cf-1072-4b37-9b5b-3b66bf36c812 None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:46.194714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3abd36cf-1072-4b37-9b5b-3b66bf36c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:46.256174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 655/1304] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:30:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:46.298829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea151d-d9e9-4ac9-bd3e-355691b60969 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:46.299114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea151d-d9e9-4ac9-bd3e-355691b60969 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:46.299384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea151d-d9e9-4ac9-bd3e-355691b60969 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:46.301179 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 650/1305] 10.222.0.16 () {54 vars in 942 bytes} [Wed Jul 28 03:30:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:46.307689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9ca6-dcfa-436e-84c2-249dd44b1c65 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:46.308008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9ca6-dcfa-436e-84c2-249dd44b1c65 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:46.308304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9ca6-dcfa-436e-84c2-249dd44b1c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:46.355849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-7b6f9ca6-dcfa-436e-84c2-249dd44b1c65 None None] MFA Rules not processed for user `7195fd0ceaf6413d80120c47b3c86358`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:46.357040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7b6f9ca6-dcfa-436e-84c2-249dd44b1c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:46.425317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 656/1306] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Jul 28 03:30:46 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:46.435250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea151d-d9e9-4ac9-bd3e-355691b60969 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:46.448391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea151d-d9e9-4ac9-bd3e-355691b60969 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:46.452943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f23846-22dc-4a5d-abd5-c45e1050a1eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:46.453575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23846-22dc-4a5d-abd5-c45e1050a1eb service swift] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:46.453855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23846-22dc-4a5d-abd5-c45e1050a1eb service swift] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:46.454123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23846-22dc-4a5d-abd5-c45e1050a1eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:46.461579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f23846-22dc-4a5d-abd5-c45e1050a1eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:46.463143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f23846-22dc-4a5d-abd5-c45e1050a1eb service swift] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:46.471291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 651/1307] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 03:30:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 03:30:46.620540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc7f3-a6f4-4eb2-a48b-b8cd03ecab89 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:46.621095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc7f3-a6f4-4eb2-a48b-b8cd03ecab89 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:46.621095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc7f3-a6f4-4eb2-a48b-b8cd03ecab89 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:46.623278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 657/1308] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:46.629521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1aa47-1e54-4a1f-9810-c67bc9507a13 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:46.629814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1aa47-1e54-4a1f-9810-c67bc9507a13 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:46.630098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1aa47-1e54-4a1f-9810-c67bc9507a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:46.647156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8bc1aa47-1e54-4a1f-9810-c67bc9507a13 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:46.648343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8bc1aa47-1e54-4a1f-9810-c67bc9507a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:46.658153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 652/1309] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:30:46.704038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc7f3-a6f4-4eb2-a48b-b8cd03ecab89 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:46.718454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc7f3-a6f4-4eb2-a48b-b8cd03ecab89 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:46.724116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fddb16-049c-42d6-b045-ec9b4cbe9bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:46.724854 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fddb16-049c-42d6-b045-ec9b4cbe9bf9 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:46.725206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fddb16-049c-42d6-b045-ec9b4cbe9bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:46.725544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fddb16-049c-42d6-b045-ec9b4cbe9bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:46.734384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fddb16-049c-42d6-b045-ec9b4cbe9bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:46.736142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fddb16-049c-42d6-b045-ec9b4cbe9bf9 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:46.749509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 658/1310] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:30:48.926640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b218-4d44-4b43-994e-d9db65f0caf7 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:48.927505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b218-4d44-4b43-994e-d9db65f0caf7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:48.927826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b218-4d44-4b43-994e-d9db65f0caf7 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:48.929891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 653/1311] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:30:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:30:48.935685 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357bb7f-e7bc-47bc-8279-78a110037310 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:48.936505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357bb7f-e7bc-47bc-8279-78a110037310 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:48.937539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357bb7f-e7bc-47bc-8279-78a110037310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:48.956638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3357bb7f-e7bc-47bc-8279-78a110037310 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:30:48.958131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3357bb7f-e7bc-47bc-8279-78a110037310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:30:48.966792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 659/1312] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:30:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:30:49.012578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b218-4d44-4b43-994e-d9db65f0caf7 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:30:49.027048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b218-4d44-4b43-994e-d9db65f0caf7 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:30:49.033916 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd727f11-4638-46c0-a753-08ceb5e9eb91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:30:49.034562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd727f11-4638-46c0-a753-08ceb5e9eb91 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:30:49.034848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd727f11-4638-46c0-a753-08ceb5e9eb91 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:30:49.035125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd727f11-4638-46c0-a753-08ceb5e9eb91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:30:49.044401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd727f11-4638-46c0-a753-08ceb5e9eb91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:30:49.046846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd727f11-4638-46c0-a753-08ceb5e9eb91 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:30:49.056723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 654/1313] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:30:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:31:03.788684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d264-7c5c-4432-8c85-0401fe16b69d None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:03.789262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d264-7c5c-4432-8c85-0401fe16b69d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:03.789262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d264-7c5c-4432-8c85-0401fe16b69d None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:03.791034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 660/1314] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:03.797642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ebd51-ec30-4a7c-8928-f24fd37f28e6 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:03.798072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ebd51-ec30-4a7c-8928-f24fd37f28e6 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:03.798200 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ebd51-ec30-4a7c-8928-f24fd37f28e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:03.815420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-530ebd51-ec30-4a7c-8928-f24fd37f28e6 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:03.816599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-530ebd51-ec30-4a7c-8928-f24fd37f28e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:03.823847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 655/1315] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:31:03.848344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8d264-7c5c-4432-8c85-0401fe16b69d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:03.860766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8d264-7c5c-4432-8c85-0401fe16b69d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:03.864892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c6127-9a5e-4f7c-b6aa-afd4bbc467b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:03.865527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6127-9a5e-4f7c-b6aa-afd4bbc467b3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:03.865801 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6127-9a5e-4f7c-b6aa-afd4bbc467b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:03.866071 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6127-9a5e-4f7c-b6aa-afd4bbc467b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:03.866789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6127-9a5e-4f7c-b6aa-afd4bbc467b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:03.868655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6127-9a5e-4f7c-b6aa-afd4bbc467b3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:03.886832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 661/1316] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:31:03 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:31:05.995110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e4b3-e5c2-40f2-8497-ce3e685732fe None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:05.995680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e4b3-e5c2-40f2-8497-ce3e685732fe None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:05.995680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e4b3-e5c2-40f2-8497-ce3e685732fe None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:05.997448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 656/1317] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:06.003460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8f37-004b-4784-9532-769dbdb5e318 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:06.003933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8f37-004b-4784-9532-769dbdb5e318 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:06.004036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8f37-004b-4784-9532-769dbdb5e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:06.020841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-bd9b8f37-004b-4784-9532-769dbdb5e318 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:06.022015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bd9b8f37-004b-4784-9532-769dbdb5e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:06.029431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 662/1318] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:06.054255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822e4b3-e5c2-40f2-8497-ce3e685732fe None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:06.066474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822e4b3-e5c2-40f2-8497-ce3e685732fe None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:06.070596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b854-7b9b-4f58-9a96-2a7a531198b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:06.071432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b854-7b9b-4f58-9a96-2a7a531198b5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:06.071737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b854-7b9b-4f58-9a96-2a7a531198b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:06.072020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b854-7b9b-4f58-9a96-2a7a531198b5 admin admin] PATH_INFO: `/v3/projects/0017173cc989466eb74d01fe59732822` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:06.082456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b854-7b9b-4f58-9a96-2a7a531198b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0017173cc989466eb74d01fe59732822)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:06.084564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b854-7b9b-4f58-9a96-2a7a531198b5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:06.086181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 657/1319] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:31:06 2021] GET /identity/v3/projects/0017173cc989466eb74d01fe59732822 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:06.093684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8f37-004b-4784-9532-769dbdb5e318 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:06.101878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8f37-004b-4784-9532-769dbdb5e318 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:06.106279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4fab5-ad53-439a-bdc7-7b08e85b289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:06.106916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fab5-ad53-439a-bdc7-7b08e85b289f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:06.107224 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fab5-ad53-439a-bdc7-7b08e85b289f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:06.107505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fab5-ad53-439a-bdc7-7b08e85b289f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:06.108919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4fab5-ad53-439a-bdc7-7b08e85b289f admin admin] RBAC: Adding query filter params (scope.project.id=0017173cc989466eb74d01fe59732822) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:31:06.109225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4fab5-ad53-439a-bdc7-7b08e85b289f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:06.111072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4fab5-ad53-439a-bdc7-7b08e85b289f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:06.117381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 663/1320] 10.222.0.16 () {56 vars in 1232 bytes} [Wed Jul 28 03:31:06 2021] GET /identity/v3/role_assignments?scope.project.id=0017173cc989466eb74d01fe59732822 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:06.123588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b854-7b9b-4f58-9a96-2a7a531198b5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:06.133243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b854-7b9b-4f58-9a96-2a7a531198b5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:06.137492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad88cfc-642a-4e85-8082-f980732014b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:06.138339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad88cfc-642a-4e85-8082-f980732014b9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:06.138618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad88cfc-642a-4e85-8082-f980732014b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:06.138892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad88cfc-642a-4e85-8082-f980732014b9 admin admin] PATH_INFO: `/v3/users/78339e49facd48729a59ae2cbfe5ebcd` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:06.152525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad88cfc-642a-4e85-8082-f980732014b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=78339e49facd48729a59ae2cbfe5ebcd)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:06.154662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad88cfc-642a-4e85-8082-f980732014b9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:06.156281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 658/1321] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:06 2021] GET /identity/v3/users/78339e49facd48729a59ae2cbfe5ebcd => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:08.341745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286cf7-71c6-4c4d-8635-e218a59c26a2 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:08.342265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286cf7-71c6-4c4d-8635-e218a59c26a2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:08.342416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286cf7-71c6-4c4d-8635-e218a59c26a2 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:08.344124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 664/1322] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:31:08.350169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9eaf-bcf4-49db-85eb-23cd2096fe0e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:08.350613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9eaf-bcf4-49db-85eb-23cd2096fe0e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:08.350715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9eaf-bcf4-49db-85eb-23cd2096fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:08.367520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-691c9eaf-bcf4-49db-85eb-23cd2096fe0e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:08.368691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-691c9eaf-bcf4-49db-85eb-23cd2096fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:08.376779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 659/1323] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:08.400542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286cf7-71c6-4c4d-8635-e218a59c26a2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:08.412167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286cf7-71c6-4c4d-8635-e218a59c26a2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:08.416295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab3fd2-6598-4203-9617-8553b8820774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:08.417124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab3fd2-6598-4203-9617-8553b8820774 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:08.417400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab3fd2-6598-4203-9617-8553b8820774 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:08.417671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab3fd2-6598-4203-9617-8553b8820774 admin admin] PATH_INFO: `/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:08.428445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab3fd2-6598-4203-9617-8553b8820774 admin admin] RBAC: Authorizing `identity:get_project(project_id=1811d1eccd8145b58dd6abce5fa5ed28)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:08.430485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab3fd2-6598-4203-9617-8553b8820774 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:08.432135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 665/1324] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:31:08 2021] GET /identity/v3/projects/1811d1eccd8145b58dd6abce5fa5ed28 => generated 361 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:08.439320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c9eaf-bcf4-49db-85eb-23cd2096fe0e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:08.447550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c9eaf-bcf4-49db-85eb-23cd2096fe0e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:08.452773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd61e3-a198-4d63-bd7b-07fa4eefc925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:08.453506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd61e3-a198-4d63-bd7b-07fa4eefc925 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:08.453789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd61e3-a198-4d63-bd7b-07fa4eefc925 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:08.454067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd61e3-a198-4d63-bd7b-07fa4eefc925 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:08.454851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd61e3-a198-4d63-bd7b-07fa4eefc925 admin admin] RBAC: Adding query filter params (scope.project.id=1811d1eccd8145b58dd6abce5fa5ed28) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:31:08.455156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd61e3-a198-4d63-bd7b-07fa4eefc925 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:08.457026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd61e3-a198-4d63-bd7b-07fa4eefc925 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:08.463749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 660/1325] 10.222.0.16 () {56 vars in 1232 bytes} [Wed Jul 28 03:31:08 2021] GET /identity/v3/role_assignments?scope.project.id=1811d1eccd8145b58dd6abce5fa5ed28 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:08.470041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab3fd2-6598-4203-9617-8553b8820774 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:08.479120 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab3fd2-6598-4203-9617-8553b8820774 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:08.483399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727289d5-d480-4b5e-ac02-e9eb73d57a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:08.484293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727289d5-d480-4b5e-ac02-e9eb73d57a58 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:08.484576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727289d5-d480-4b5e-ac02-e9eb73d57a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:08.484851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727289d5-d480-4b5e-ac02-e9eb73d57a58 admin admin] PATH_INFO: `/v3/users/30d2e5c9b1ac4ababd5f81e5d20c91f9` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:08.497713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727289d5-d480-4b5e-ac02-e9eb73d57a58 admin admin] RBAC: Authorizing `identity:get_user(user_id=30d2e5c9b1ac4ababd5f81e5d20c91f9)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:08.500409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727289d5-d480-4b5e-ac02-e9eb73d57a58 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:08.501966 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 666/1326] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:08 2021] GET /identity/v3/users/30d2e5c9b1ac4ababd5f81e5d20c91f9 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:10.647666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f790a6-8599-410d-8f2d-836ee6cb9405 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:10.648244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f790a6-8599-410d-8f2d-836ee6cb9405 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:10.648476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f790a6-8599-410d-8f2d-836ee6cb9405 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:10.650269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 661/1327] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:10.656264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19a89-f2cc-4e7f-ba16-8d8b49d37d56 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:10.656686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19a89-f2cc-4e7f-ba16-8d8b49d37d56 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:10.656861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19a89-f2cc-4e7f-ba16-8d8b49d37d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:10.673425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-04b19a89-f2cc-4e7f-ba16-8d8b49d37d56 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:10.674586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-04b19a89-f2cc-4e7f-ba16-8d8b49d37d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:10.682763 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 667/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:31:10.707889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f790a6-8599-410d-8f2d-836ee6cb9405 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:10.720195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f790a6-8599-410d-8f2d-836ee6cb9405 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:10.724561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fea85-dd44-4503-af06-d3e23e80fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:10.725396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fea85-dd44-4503-af06-d3e23e80fc1d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:10.725677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fea85-dd44-4503-af06-d3e23e80fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:10.725954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fea85-dd44-4503-af06-d3e23e80fc1d admin admin] PATH_INFO: `/v3/projects/36c308cc13dd4268b9f547b35c08e22a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:10.737342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fea85-dd44-4503-af06-d3e23e80fc1d admin admin] RBAC: Authorizing `identity:get_project(project_id=36c308cc13dd4268b9f547b35c08e22a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:10.739388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fea85-dd44-4503-af06-d3e23e80fc1d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:10.741031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 662/1329] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:31:10 2021] GET /identity/v3/projects/36c308cc13dd4268b9f547b35c08e22a => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:10.747416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b19a89-f2cc-4e7f-ba16-8d8b49d37d56 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:10.755902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b19a89-f2cc-4e7f-ba16-8d8b49d37d56 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:10.760113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:10.760742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:10.761020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:10.761287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:10.762036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] RBAC: Adding query filter params (scope.project.id=36c308cc13dd4268b9f547b35c08e22a) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:31:10.762339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:10.764198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:10.769860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 668/1330] 10.222.0.16 () {56 vars in 1232 bytes} [Wed Jul 28 03:31:10 2021] GET /identity/v3/role_assignments?scope.project.id=36c308cc13dd4268b9f547b35c08e22a => generated 877 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:31:10.775956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fea85-dd44-4503-af06-d3e23e80fc1d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:10.785325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fea85-dd44-4503-af06-d3e23e80fc1d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:10.789579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef07c5-62c8-47f3-9323-643f55fbb4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:10.790410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef07c5-62c8-47f3-9323-643f55fbb4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:10.790687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef07c5-62c8-47f3-9323-643f55fbb4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:10.790958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef07c5-62c8-47f3-9323-643f55fbb4a7 admin admin] PATH_INFO: `/v3/users/becce1fb25a14d4d8b4c004b7bb49281` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:10.804475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef07c5-62c8-47f3-9323-643f55fbb4a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=becce1fb25a14d4d8b4c004b7bb49281)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:10.806579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef07c5-62c8-47f3-9323-643f55fbb4a7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:10.808289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 663/1331] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:10 2021] GET /identity/v3/users/becce1fb25a14d4d8b4c004b7bb49281 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:10.814231 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:10.823051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d17d4-7e06-4da6-a10d-abb19dfe52e9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:10.827737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51335640-1ed6-456a-a99c-477cdd3ae753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:10.828582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335640-1ed6-456a-a99c-477cdd3ae753 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:10.828853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335640-1ed6-456a-a99c-477cdd3ae753 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:10.829120 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335640-1ed6-456a-a99c-477cdd3ae753 admin admin] PATH_INFO: `/v3/users/ce945381c53f4dbd900446045487f458` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:10.843197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51335640-1ed6-456a-a99c-477cdd3ae753 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce945381c53f4dbd900446045487f458)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:10.845334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51335640-1ed6-456a-a99c-477cdd3ae753 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:10.846878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 669/1332] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:10 2021] GET /identity/v3/users/ce945381c53f4dbd900446045487f458 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:13.042581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bc7a-e078-4101-9b51-03032f212cfe None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:13.043117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bc7a-e078-4101-9b51-03032f212cfe None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:13.043117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bc7a-e078-4101-9b51-03032f212cfe None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:13.044910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 664/1333] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:13.050926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972ee59-03f6-4dea-a019-ff7ec39dd523 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:13.051357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972ee59-03f6-4dea-a019-ff7ec39dd523 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:13.051465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972ee59-03f6-4dea-a019-ff7ec39dd523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:13.069393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e972ee59-03f6-4dea-a019-ff7ec39dd523 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:13.070541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e972ee59-03f6-4dea-a019-ff7ec39dd523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:13.078526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 670/1334] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:13.103279 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9bc7a-e078-4101-9b51-03032f212cfe None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:13.115187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9bc7a-e078-4101-9b51-03032f212cfe None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:13.119485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252fa71-5a9e-47c3-bf3a-289c69a1fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:13.120357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252fa71-5a9e-47c3-bf3a-289c69a1fbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:13.120634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252fa71-5a9e-47c3-bf3a-289c69a1fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:13.120902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252fa71-5a9e-47c3-bf3a-289c69a1fbe4 admin admin] PATH_INFO: `/v3/projects/3c6f764cee714a30baaf63707c28b80f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:13.131600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252fa71-5a9e-47c3-bf3a-289c69a1fbe4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6f764cee714a30baaf63707c28b80f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:13.133692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252fa71-5a9e-47c3-bf3a-289c69a1fbe4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:13.135347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 665/1335] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:31:13 2021] GET /identity/v3/projects/3c6f764cee714a30baaf63707c28b80f => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:13.142431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972ee59-03f6-4dea-a019-ff7ec39dd523 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:13.150876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972ee59-03f6-4dea-a019-ff7ec39dd523 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:13.155720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:13.156373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:13.156651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:13.156915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:13.157665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] RBAC: Adding query filter params (scope.project.id=3c6f764cee714a30baaf63707c28b80f) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:31:13.157964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:13.159829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:13.166399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 671/1336] 10.222.0.16 () {56 vars in 1232 bytes} [Wed Jul 28 03:31:13 2021] GET /identity/v3/role_assignments?scope.project.id=3c6f764cee714a30baaf63707c28b80f => generated 1934 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:31:13.172842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252fa71-5a9e-47c3-bf3a-289c69a1fbe4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:13.181782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252fa71-5a9e-47c3-bf3a-289c69a1fbe4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:13.186030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408e25d-25a0-4a42-93fc-7087288a0728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:13.186926 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e25d-25a0-4a42-93fc-7087288a0728 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:13.187199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e25d-25a0-4a42-93fc-7087288a0728 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:13.187465 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e25d-25a0-4a42-93fc-7087288a0728 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:13.188608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408e25d-25a0-4a42-93fc-7087288a0728 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:13.190373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408e25d-25a0-4a42-93fc-7087288a0728 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:13.191886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 666/1337] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:13 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:13.197684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:13.207212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680a367-d8b8-4cfe-bbed-a75847db40f9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:13.211507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d4ed-ff7c-4995-80a4-15a8be39cbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:13.212388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d4ed-ff7c-4995-80a4-15a8be39cbba admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:13.212669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d4ed-ff7c-4995-80a4-15a8be39cbba admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:13.212942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d4ed-ff7c-4995-80a4-15a8be39cbba admin admin] PATH_INFO: `/v3/users/33a0b74416ef4bec9cc68a2c97e65985` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:13.227093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834d4ed-ff7c-4995-80a4-15a8be39cbba admin admin] RBAC: Authorizing `identity:get_user(user_id=33a0b74416ef4bec9cc68a2c97e65985)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:13.229260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834d4ed-ff7c-4995-80a4-15a8be39cbba admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:13.230818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 672/1338] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:13 2021] GET /identity/v3/users/33a0b74416ef4bec9cc68a2c97e65985 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:15.432897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c07c-c915-41dd-8fb6-bf0c42c9bfaf None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:15.433421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c07c-c915-41dd-8fb6-bf0c42c9bfaf None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:15.433421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c07c-c915-41dd-8fb6-bf0c42c9bfaf None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:15.435118 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 667/1339] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:15.441628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70d1a9-e842-4ee4-94b5-9889058febc9 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:15.442054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70d1a9-e842-4ee4-94b5-9889058febc9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:15.442251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70d1a9-e842-4ee4-94b5-9889058febc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:15.459112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-7c70d1a9-e842-4ee4-94b5-9889058febc9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:15.460286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7c70d1a9-e842-4ee4-94b5-9889058febc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:15.468032 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 673/1340] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:15.491971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c07c-c915-41dd-8fb6-bf0c42c9bfaf None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:15.504015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c07c-c915-41dd-8fb6-bf0c42c9bfaf None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:15.508154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e472f-444f-441e-a365-277a7c54664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:15.508991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e472f-444f-441e-a365-277a7c54664c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:15.509267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e472f-444f-441e-a365-277a7c54664c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:15.509536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e472f-444f-441e-a365-277a7c54664c admin admin] PATH_INFO: `/v3/projects/a74500eac66c48568f2eb64dd512dfc6` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:15.510643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e472f-444f-441e-a365-277a7c54664c admin admin] RBAC: Authorizing `identity:get_project(project_id=a74500eac66c48568f2eb64dd512dfc6)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:15.512469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e472f-444f-441e-a365-277a7c54664c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:15.514043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 668/1341] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:31:15 2021] GET /identity/v3/projects/a74500eac66c48568f2eb64dd512dfc6 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:15.520164 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70d1a9-e842-4ee4-94b5-9889058febc9 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:15.528344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70d1a9-e842-4ee4-94b5-9889058febc9 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:15.533019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953ca30-9411-4f08-8c6a-de4219d9cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:15.533642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ca30-9411-4f08-8c6a-de4219d9cc9b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:15.533919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ca30-9411-4f08-8c6a-de4219d9cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:15.534189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ca30-9411-4f08-8c6a-de4219d9cc9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:15.534940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953ca30-9411-4f08-8c6a-de4219d9cc9b admin admin] RBAC: Adding query filter params (scope.project.id=a74500eac66c48568f2eb64dd512dfc6) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:31:15.535238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953ca30-9411-4f08-8c6a-de4219d9cc9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:15.537113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953ca30-9411-4f08-8c6a-de4219d9cc9b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:15.542606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 674/1342] 10.222.0.16 () {56 vars in 1232 bytes} [Wed Jul 28 03:31:15 2021] GET /identity/v3/role_assignments?scope.project.id=a74500eac66c48568f2eb64dd512dfc6 => generated 879 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:31:15.549444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e472f-444f-441e-a365-277a7c54664c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:15.558312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e472f-444f-441e-a365-277a7c54664c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:15.563801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66abfc-6636-403f-9e5f-2ee4fd309845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:15.564653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66abfc-6636-403f-9e5f-2ee4fd309845 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:15.564928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66abfc-6636-403f-9e5f-2ee4fd309845 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:15.565199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66abfc-6636-403f-9e5f-2ee4fd309845 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:15.566335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66abfc-6636-403f-9e5f-2ee4fd309845 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:15.568149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66abfc-6636-403f-9e5f-2ee4fd309845 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:15.569684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 669/1343] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:15 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:17.700896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b24d5-227b-4de9-809c-516511d58aae None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:17.701457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b24d5-227b-4de9-809c-516511d58aae None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:17.701457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b24d5-227b-4de9-809c-516511d58aae None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:17.703751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 675/1344] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:17.709550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd639-c65c-4846-8a25-5fe48a1d6ee6 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:17.709945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd639-c65c-4846-8a25-5fe48a1d6ee6 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:17.710103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd639-c65c-4846-8a25-5fe48a1d6ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:17.727795 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5aabd639-c65c-4846-8a25-5fe48a1d6ee6 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:17.728943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5aabd639-c65c-4846-8a25-5fe48a1d6ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:17.736196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 670/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:31:17.759475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b24d5-227b-4de9-809c-516511d58aae None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:17.771699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b24d5-227b-4de9-809c-516511d58aae None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:17.775809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5892a7-5fc3-49b2-819b-ebcf57b53190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:17.776640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5892a7-5fc3-49b2-819b-ebcf57b53190 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:17.776917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5892a7-5fc3-49b2-819b-ebcf57b53190 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:17.777187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5892a7-5fc3-49b2-819b-ebcf57b53190 admin admin] PATH_INFO: `/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:17.788773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5892a7-5fc3-49b2-819b-ebcf57b53190 admin admin] RBAC: Authorizing `identity:get_project(project_id=efa4dc6cc4314e2b99265a59d8e879f7)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:17.790819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5892a7-5fc3-49b2-819b-ebcf57b53190 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:17.792466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 676/1346] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:31:17 2021] GET /identity/v3/projects/efa4dc6cc4314e2b99265a59d8e879f7 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:17.798747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd639-c65c-4846-8a25-5fe48a1d6ee6 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:17.806944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd639-c65c-4846-8a25-5fe48a1d6ee6 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:17.811224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322aa1b4-ba0b-45fd-93fd-6cacc192ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:17.812057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322aa1b4-ba0b-45fd-93fd-6cacc192ca28 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:17.812339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322aa1b4-ba0b-45fd-93fd-6cacc192ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:17.812613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322aa1b4-ba0b-45fd-93fd-6cacc192ca28 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:17.813369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322aa1b4-ba0b-45fd-93fd-6cacc192ca28 admin admin] RBAC: Adding query filter params (scope.project.id=efa4dc6cc4314e2b99265a59d8e879f7) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:31:17.813671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322aa1b4-ba0b-45fd-93fd-6cacc192ca28 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:17.815501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322aa1b4-ba0b-45fd-93fd-6cacc192ca28 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:17.820735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 671/1347] 10.222.0.16 () {56 vars in 1232 bytes} [Wed Jul 28 03:31:17 2021] GET /identity/v3/role_assignments?scope.project.id=efa4dc6cc4314e2b99265a59d8e879f7 => generated 526 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:17.827177 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5892a7-5fc3-49b2-819b-ebcf57b53190 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:17.836096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5892a7-5fc3-49b2-819b-ebcf57b53190 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:17.840319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbf61b-817c-40a7-8a2a-af19feee864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:17.841410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbf61b-817c-40a7-8a2a-af19feee864f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:17.841689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbf61b-817c-40a7-8a2a-af19feee864f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:17.841961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbf61b-817c-40a7-8a2a-af19feee864f admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:17.855505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbf61b-817c-40a7-8a2a-af19feee864f admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:17.857662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbf61b-817c-40a7-8a2a-af19feee864f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:17.859316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 677/1348] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:17 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:19.992146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc262-0d00-401d-82c1-afafe975ee25 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:19.992744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc262-0d00-401d-82c1-afafe975ee25 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:19.992744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc262-0d00-401d-82c1-afafe975ee25 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:19.994488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 672/1349] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:20.000908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8d84-1c62-454a-97b0-3cea7c13b455 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:20.001326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8d84-1c62-454a-97b0-3cea7c13b455 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:20.001463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8d84-1c62-454a-97b0-3cea7c13b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:20.018512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9a6e8d84-1c62-454a-97b0-3cea7c13b455 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:20.019667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9a6e8d84-1c62-454a-97b0-3cea7c13b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:20.026896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 678/1350] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:20.051536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbc262-0d00-401d-82c1-afafe975ee25 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:20.064335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbc262-0d00-401d-82c1-afafe975ee25 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:20.068732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012c81-2ffa-4b0c-aa19-027094ee2f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:20.069617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012c81-2ffa-4b0c-aa19-027094ee2f32 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:20.069903 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012c81-2ffa-4b0c-aa19-027094ee2f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:20.070177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012c81-2ffa-4b0c-aa19-027094ee2f32 admin admin] PATH_INFO: `/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:20.082060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15012c81-2ffa-4b0c-aa19-027094ee2f32 admin admin] RBAC: Authorizing `identity:get_project(project_id=feedc0ac0cb84d54814ecf5dd5cd7b8b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:20.084199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15012c81-2ffa-4b0c-aa19-027094ee2f32 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:20.085994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 673/1351] 10.222.0.16 () {56 vars in 1208 bytes} [Wed Jul 28 03:31:20 2021] GET /identity/v3/projects/feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:20.093227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8d84-1c62-454a-97b0-3cea7c13b455 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:20.102420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8d84-1c62-454a-97b0-3cea7c13b455 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:20.106927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:20.107607 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:20.108481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:20.108758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:20.109543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] RBAC: Adding query filter params (scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:31:20.109844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:20.111786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:20.122956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 679/1352] 10.222.0.16 () {56 vars in 1232 bytes} [Wed Jul 28 03:31:20 2021] GET /identity/v3/role_assignments?scope.project.id=feedc0ac0cb84d54814ecf5dd5cd7b8b => generated 1934 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:31:20.130482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012c81-2ffa-4b0c-aa19-027094ee2f32 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:20.140495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012c81-2ffa-4b0c-aa19-027094ee2f32 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:20.144868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef987066-0a8b-45af-81e3-2773da51a295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:20.145756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987066-0a8b-45af-81e3-2773da51a295 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:20.146036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987066-0a8b-45af-81e3-2773da51a295 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:20.146311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987066-0a8b-45af-81e3-2773da51a295 admin admin] PATH_INFO: `/v3/users/398ba2372d694a5b8498f1f6df8ec46d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:20.147464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef987066-0a8b-45af-81e3-2773da51a295 admin admin] RBAC: Authorizing `identity:get_user(user_id=398ba2372d694a5b8498f1f6df8ec46d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:20.149332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef987066-0a8b-45af-81e3-2773da51a295 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:20.150946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 674/1353] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:20 2021] GET /identity/v3/users/398ba2372d694a5b8498f1f6df8ec46d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:20.157566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:20.166912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7936ad-ec2a-4325-abe8-6fa603c9b500 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:20.171931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fd0cf-d84d-471c-b234-7ab2db5f5f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:20.172787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fd0cf-d84d-471c-b234-7ab2db5f5f87 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:20.173070 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fd0cf-d84d-471c-b234-7ab2db5f5f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:20.173346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fd0cf-d84d-471c-b234-7ab2db5f5f87 admin admin] PATH_INFO: `/v3/users/beb11f34c6cf46fe9a631e0e48e77875` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:20.174481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fd0cf-d84d-471c-b234-7ab2db5f5f87 admin admin] RBAC: Authorizing `identity:get_user(user_id=beb11f34c6cf46fe9a631e0e48e77875)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:20.176649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fd0cf-d84d-471c-b234-7ab2db5f5f87 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:20.178206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 680/1354] 10.222.0.16 () {56 vars in 1199 bytes} [Wed Jul 28 03:31:20 2021] GET /identity/v3/users/beb11f34c6cf46fe9a631e0e48e77875 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:31:25.453633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce82d5e-7057-4b5b-b44f-1f6049578a00 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:25.454220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce82d5e-7057-4b5b-b44f-1f6049578a00 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:25.454220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce82d5e-7057-4b5b-b44f-1f6049578a00 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:25.456004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 675/1355] 10.222.0.16 () {54 vars in 918 bytes} [Wed Jul 28 03:31:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:25.461749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd71f7-4abe-4f5d-9c12-12ae7146ec67 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:25.462196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd71f7-4abe-4f5d-9c12-12ae7146ec67 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:25.462329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd71f7-4abe-4f5d-9c12-12ae7146ec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:25.480344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c4dd71f7-4abe-4f5d-9c12-12ae7146ec67 None None] MFA Rules not processed for user `d2b5335392b4400d94f1dfce0e010b74`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:25.481499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c4dd71f7-4abe-4f5d-9c12-12ae7146ec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:25.489972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 681/1356] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Jul 28 03:31:25 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:25.504968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79854-7eb9-4c5c-8f2b-fc0b2020ca44 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:25.505258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79854-7eb9-4c5c-8f2b-fc0b2020ca44 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:25.505562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79854-7eb9-4c5c-8f2b-fc0b2020ca44 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:25.507326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 676/1357] 10.222.0.16 () {54 vars in 918 bytes} [Wed Jul 28 03:31:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:25.512301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3601be2-2138-4927-8d5d-b509d3ded8a2 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:25.512591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3601be2-2138-4927-8d5d-b509d3ded8a2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:25.512865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3601be2-2138-4927-8d5d-b509d3ded8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:25.530183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d3601be2-2138-4927-8d5d-b509d3ded8a2 None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:25.531314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d3601be2-2138-4927-8d5d-b509d3ded8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:25.539600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 682/1358] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Jul 28 03:31:25 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:28.319905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4460b17-4d7f-46c3-9e91-bf44e41726a5 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:28.320455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4460b17-4d7f-46c3-9e91-bf44e41726a5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:28.320455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4460b17-4d7f-46c3-9e91-bf44e41726a5 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:28.322209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 677/1359] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:28.328173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179147c-9d35-43ce-aae8-b6a3ff014d63 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:28.328616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179147c-9d35-43ce-aae8-b6a3ff014d63 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:28.328756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179147c-9d35-43ce-aae8-b6a3ff014d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:28.346329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e179147c-9d35-43ce-aae8-b6a3ff014d63 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:28.347497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e179147c-9d35-43ce-aae8-b6a3ff014d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:28.354590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 683/1360] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:28.398112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4460b17-4d7f-46c3-9e91-bf44e41726a5 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:28.411432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4460b17-4d7f-46c3-9e91-bf44e41726a5 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:28.416344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe36aa2-ce41-4026-a2f4-b22f6a8aaffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:28.416971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36aa2-ce41-4026-a2f4-b22f6a8aaffd service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:28.417248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36aa2-ce41-4026-a2f4-b22f6a8aaffd service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:28.417518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36aa2-ce41-4026-a2f4-b22f6a8aaffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:28.425655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe36aa2-ce41-4026-a2f4-b22f6a8aaffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:28.427213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe36aa2-ce41-4026-a2f4-b22f6a8aaffd service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:28.435587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 678/1361] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:29.828377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3303-1627-436f-b98c-5596048cb5f3 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:29.828939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3303-1627-436f-b98c-5596048cb5f3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:29.828939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3303-1627-436f-b98c-5596048cb5f3 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:29.830782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 684/1362] 10.222.0.16 () {54 vars in 911 bytes} [Wed Jul 28 03:31:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:29.836493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43742-b97e-417f-b4bd-cad3326de153 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:29.836960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43742-b97e-417f-b4bd-cad3326de153 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:29.837055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43742-b97e-417f-b4bd-cad3326de153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:29.854966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ece43742-b97e-417f-b4bd-cad3326de153 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:29.856133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ece43742-b97e-417f-b4bd-cad3326de153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:29.863395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 679/1363] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 28 03:31:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:30.012887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3303-1627-436f-b98c-5596048cb5f3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:30.027946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3303-1627-436f-b98c-5596048cb5f3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:30.033603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774ab43-2187-44fa-bfb2-e032ce302bb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:30.034250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ab43-2187-44fa-bfb2-e032ce302bb9 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:30.034532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ab43-2187-44fa-bfb2-e032ce302bb9 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:30.034963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774ab43-2187-44fa-bfb2-e032ce302bb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:30.042865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774ab43-2187-44fa-bfb2-e032ce302bb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:30.044523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774ab43-2187-44fa-bfb2-e032ce302bb9 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:30.053240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 685/1364] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:31.448579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbea32-c79a-4dd5-b39f-6ede1f646221 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:31.449103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbea32-c79a-4dd5-b39f-6ede1f646221 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:31.449103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbea32-c79a-4dd5-b39f-6ede1f646221 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:31.450946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 680/1365] 10.222.0.16 () {54 vars in 911 bytes} [Wed Jul 28 03:31:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:31.457358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a2a8f-2fb1-4e63-b7ab-c24575279f6b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:31.457781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a2a8f-2fb1-4e63-b7ab-c24575279f6b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:31.457921 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a2a8f-2fb1-4e63-b7ab-c24575279f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:31.475286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-4d5a2a8f-2fb1-4e63-b7ab-c24575279f6b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:31.476484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4d5a2a8f-2fb1-4e63-b7ab-c24575279f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:31.483856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 686/1366] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 28 03:31:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:31.638392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbea32-c79a-4dd5-b39f-6ede1f646221 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:31.652218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbea32-c79a-4dd5-b39f-6ede1f646221 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:31.657814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759332d4-046b-4d50-b7b6-5826c560c983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:31.658440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759332d4-046b-4d50-b7b6-5826c560c983 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:31.658719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759332d4-046b-4d50-b7b6-5826c560c983 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:31.658993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759332d4-046b-4d50-b7b6-5826c560c983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:31.666432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759332d4-046b-4d50-b7b6-5826c560c983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:31.668024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759332d4-046b-4d50-b7b6-5826c560c983 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:31.677016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 681/1367] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:33.053387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3b5a-17da-4e80-b766-5e2db0fdee09 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:33.053938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3b5a-17da-4e80-b766-5e2db0fdee09 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:33.053938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3b5a-17da-4e80-b766-5e2db0fdee09 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:33.055773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 687/1368] 10.222.0.16 () {54 vars in 911 bytes} [Wed Jul 28 03:31:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:33.062103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b73c5-f6a2-4fdd-b6be-2fa2820ae729 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:33.062534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b73c5-f6a2-4fdd-b6be-2fa2820ae729 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:33.062653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b73c5-f6a2-4fdd-b6be-2fa2820ae729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:33.080081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ae1b73c5-f6a2-4fdd-b6be-2fa2820ae729 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:33.081228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ae1b73c5-f6a2-4fdd-b6be-2fa2820ae729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:33.088352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 682/1369] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 28 03:31:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:33.246695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc3b5a-17da-4e80-b766-5e2db0fdee09 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:33.260598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc3b5a-17da-4e80-b766-5e2db0fdee09 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:33.266331 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290ec20-d5b9-439d-8170-c920a0fcf2c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:33.266962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ec20-d5b9-439d-8170-c920a0fcf2c4 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:33.267238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ec20-d5b9-439d-8170-c920a0fcf2c4 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:33.267511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ec20-d5b9-439d-8170-c920a0fcf2c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:33.276742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290ec20-d5b9-439d-8170-c920a0fcf2c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:33.278340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290ec20-d5b9-439d-8170-c920a0fcf2c4 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:33.287428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 688/1370] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:34.675957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572921-6229-4661-b7d5-46fa3140706e None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:34.676515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572921-6229-4661-b7d5-46fa3140706e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:34.676515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572921-6229-4661-b7d5-46fa3140706e None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:34.678307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 683/1371] 10.222.0.16 () {54 vars in 911 bytes} [Wed Jul 28 03:31:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:34.683640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdae45-7254-478c-9866-9183a6782c41 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:34.684087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdae45-7254-478c-9866-9183a6782c41 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:34.684262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdae45-7254-478c-9866-9183a6782c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:34.703502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e5bdae45-7254-478c-9866-9183a6782c41 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:34.704674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e5bdae45-7254-478c-9866-9183a6782c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:34.711816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 689/1372] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 28 03:31:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:34.863397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71572921-6229-4661-b7d5-46fa3140706e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:34.878794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71572921-6229-4661-b7d5-46fa3140706e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:34.883946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319db7ca-48ac-4dfd-9f31-b428f7d3cfe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:34.884589 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319db7ca-48ac-4dfd-9f31-b428f7d3cfe0 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:34.884871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319db7ca-48ac-4dfd-9f31-b428f7d3cfe0 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:34.885148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319db7ca-48ac-4dfd-9f31-b428f7d3cfe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:34.892913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319db7ca-48ac-4dfd-9f31-b428f7d3cfe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:34.894502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319db7ca-48ac-4dfd-9f31-b428f7d3cfe0 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:34.902990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 684/1373] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:36.222121 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5dde-4456-4ad7-b5a6-945b36c6ecbe None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:36.222643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5dde-4456-4ad7-b5a6-945b36c6ecbe None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:36.222643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5dde-4456-4ad7-b5a6-945b36c6ecbe None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:36.224470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 690/1374] 10.222.0.16 () {54 vars in 911 bytes} [Wed Jul 28 03:31:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:36.230081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67deb71-3364-4a88-a0b2-e0c51ea327ad None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:36.230528 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67deb71-3364-4a88-a0b2-e0c51ea327ad None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:36.230632 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67deb71-3364-4a88-a0b2-e0c51ea327ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:36.247517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-e67deb71-3364-4a88-a0b2-e0c51ea327ad None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:36.249290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e67deb71-3364-4a88-a0b2-e0c51ea327ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:36.256320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 685/1375] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 28 03:31:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:31:36.409865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e5dde-4456-4ad7-b5a6-945b36c6ecbe None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:36.423498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e5dde-4456-4ad7-b5a6-945b36c6ecbe None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:36.428465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20b8b-96c4-499e-b067-6eae76223bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:36.429093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20b8b-96c4-499e-b067-6eae76223bae service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:36.429374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20b8b-96c4-499e-b067-6eae76223bae service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:36.429642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20b8b-96c4-499e-b067-6eae76223bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:36.437681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb20b8b-96c4-499e-b067-6eae76223bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:36.439258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb20b8b-96c4-499e-b067-6eae76223bae service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:36.447631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 691/1376] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:37.774253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c030f-9c74-4e67-a27b-d4dd6cf97705 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:37.774817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c030f-9c74-4e67-a27b-d4dd6cf97705 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:37.774817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c030f-9c74-4e67-a27b-d4dd6cf97705 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:37.776872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 686/1377] 10.222.0.16 () {54 vars in 911 bytes} [Wed Jul 28 03:31:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:37.782520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a6e5-ead6-4604-abda-5fa26a7ce1cc None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:37.782967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a6e5-ead6-4604-abda-5fa26a7ce1cc None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:37.783098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a6e5-ead6-4604-abda-5fa26a7ce1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:37.800532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fb78a6e5-ead6-4604-abda-5fa26a7ce1cc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:37.801683 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fb78a6e5-ead6-4604-abda-5fa26a7ce1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:37.808790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 692/1378] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 28 03:31:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:37.960590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c030f-9c74-4e67-a27b-d4dd6cf97705 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:37.973739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c030f-9c74-4e67-a27b-d4dd6cf97705 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:37.978904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c02f6-b614-4413-9426-2a4166a19546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:37.979528 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c02f6-b614-4413-9426-2a4166a19546 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:37.979837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c02f6-b614-4413-9426-2a4166a19546 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:37.980109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c02f6-b614-4413-9426-2a4166a19546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:37.987936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c02f6-b614-4413-9426-2a4166a19546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:37.989494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c02f6-b614-4413-9426-2a4166a19546 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:37.997890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 687/1379] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:39.311873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416c62-b56c-4178-aa78-a40ae13ad86e None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:39.312376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416c62-b56c-4178-aa78-a40ae13ad86e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:39.312480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416c62-b56c-4178-aa78-a40ae13ad86e None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:39.314246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 693/1380] 10.222.0.16 () {54 vars in 911 bytes} [Wed Jul 28 03:31:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:39.319894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3f4b-6e89-4e94-91d6-4bf8ee891427 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:39.320312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3f4b-6e89-4e94-91d6-4bf8ee891427 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:39.320442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3f4b-6e89-4e94-91d6-4bf8ee891427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:39.338789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-319d3f4b-6e89-4e94-91d6-4bf8ee891427 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:39.339979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-319d3f4b-6e89-4e94-91d6-4bf8ee891427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:39.347923 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 688/1381] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 28 03:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:39.500670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc416c62-b56c-4178-aa78-a40ae13ad86e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:39.514334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc416c62-b56c-4178-aa78-a40ae13ad86e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:39.519361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea6388-d24c-4ee5-a14c-c5c77495ac2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:39.520032 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea6388-d24c-4ee5-a14c-c5c77495ac2d service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:39.520316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea6388-d24c-4ee5-a14c-c5c77495ac2d service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:39.520591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea6388-d24c-4ee5-a14c-c5c77495ac2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:39.528079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea6388-d24c-4ee5-a14c-c5c77495ac2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:39.530430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea6388-d24c-4ee5-a14c-c5c77495ac2d service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:39.538961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 694/1382] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:40.853612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c71a4-7ba0-4af1-a109-54f1ffc7541a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:40.854183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c71a4-7ba0-4af1-a109-54f1ffc7541a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:40.854183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c71a4-7ba0-4af1-a109-54f1ffc7541a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:40.855984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 689/1383] 10.222.0.16 () {54 vars in 911 bytes} [Wed Jul 28 03:31:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:40.862154 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb699a-e084-4179-acb4-678efcb5b006 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:40.862574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb699a-e084-4179-acb4-678efcb5b006 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:40.862741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb699a-e084-4179-acb4-678efcb5b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:40.880279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1ccb699a-e084-4179-acb4-678efcb5b006 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:40.881429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1ccb699a-e084-4179-acb4-678efcb5b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:40.888597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 695/1384] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 28 03:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:41.041083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c71a4-7ba0-4af1-a109-54f1ffc7541a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:41.054585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c71a4-7ba0-4af1-a109-54f1ffc7541a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:41.059565 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282a5c-161c-4f12-9b19-540c58d15ee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:41.060215 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282a5c-161c-4f12-9b19-540c58d15ee4 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:41.061150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282a5c-161c-4f12-9b19-540c58d15ee4 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:41.061428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282a5c-161c-4f12-9b19-540c58d15ee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:41.068872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08282a5c-161c-4f12-9b19-540c58d15ee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:41.070474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08282a5c-161c-4f12-9b19-540c58d15ee4 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:41.078930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 690/1385] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:43.111975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce47d4-a0b5-4b93-9231-96c6ebc97d3e None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:43.112501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce47d4-a0b5-4b93-9231-96c6ebc97d3e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:43.112628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce47d4-a0b5-4b93-9231-96c6ebc97d3e None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:43.114325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 696/1386] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:43.120445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede88c8-8280-40e4-afa6-aa4370a39234 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:43.120870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede88c8-8280-40e4-afa6-aa4370a39234 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:43.120987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede88c8-8280-40e4-afa6-aa4370a39234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:43.138438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2ede88c8-8280-40e4-afa6-aa4370a39234 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:43.139606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2ede88c8-8280-40e4-afa6-aa4370a39234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:43.146679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 691/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:43.185169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce47d4-a0b5-4b93-9231-96c6ebc97d3e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:43.195894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce47d4-a0b5-4b93-9231-96c6ebc97d3e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:43.199170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff1181-8fc4-4fd2-bf05-955b8a0a68b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:43.199842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1181-8fc4-4fd2-bf05-955b8a0a68b7 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:43.200125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1181-8fc4-4fd2-bf05-955b8a0a68b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:43.200399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1181-8fc4-4fd2-bf05-955b8a0a68b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:43.208813 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff1181-8fc4-4fd2-bf05-955b8a0a68b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:43.210241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff1181-8fc4-4fd2-bf05-955b8a0a68b7 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:43.219255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 697/1388] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:45.491956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4915-9130-46ff-9c41-1cfd01c9685a None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:45.492472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4915-9130-46ff-9c41-1cfd01c9685a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:45.492472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4915-9130-46ff-9c41-1cfd01c9685a None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:45.494228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 692/1389] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:45.501022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6260c-6758-43e0-8c78-d4541d4068af None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:45.501438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6260c-6758-43e0-8c78-d4541d4068af None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:45.501581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6260c-6758-43e0-8c78-d4541d4068af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:45.518658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-49d6260c-6758-43e0-8c78-d4541d4068af None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:45.519844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-49d6260c-6758-43e0-8c78-d4541d4068af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:45.526857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 698/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:45.565601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b4915-9130-46ff-9c41-1cfd01c9685a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:45.575690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b4915-9130-46ff-9c41-1cfd01c9685a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:45.579154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2f737-9632-42ee-ad8b-9bbf4b744632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:45.579817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2f737-9632-42ee-ad8b-9bbf4b744632 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:45.580102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2f737-9632-42ee-ad8b-9bbf4b744632 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:45.580375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2f737-9632-42ee-ad8b-9bbf4b744632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:45.588747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2f737-9632-42ee-ad8b-9bbf4b744632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:45.590170 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2f737-9632-42ee-ad8b-9bbf4b744632 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:45.599295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 693/1391] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:48.024902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be820-b1f2-4284-b6a8-d26bebfc570c None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:48.025436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be820-b1f2-4284-b6a8-d26bebfc570c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:48.025436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be820-b1f2-4284-b6a8-d26bebfc570c None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:48.027225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 699/1392] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:48.033751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089a4f-a88b-4fb7-aa0d-5979d5c3aa10 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:48.034215 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089a4f-a88b-4fb7-aa0d-5979d5c3aa10 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:48.034310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089a4f-a88b-4fb7-aa0d-5979d5c3aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:48.051696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9a089a4f-a88b-4fb7-aa0d-5979d5c3aa10 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:48.052869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9a089a4f-a88b-4fb7-aa0d-5979d5c3aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:48.060183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 694/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:48.098745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be820-b1f2-4284-b6a8-d26bebfc570c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:48.109494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be820-b1f2-4284-b6a8-d26bebfc570c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:48.112847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb75af-d03f-4506-b803-0f2fab56df5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:48.113480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb75af-d03f-4506-b803-0f2fab56df5e service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:48.113761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb75af-d03f-4506-b803-0f2fab56df5e service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:48.114035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb75af-d03f-4506-b803-0f2fab56df5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:48.122369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb75af-d03f-4506-b803-0f2fab56df5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:48.123883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb75af-d03f-4506-b803-0f2fab56df5e service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:48.132626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 700/1394] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:31:50.413743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1cef4-56e3-4617-89c8-9d292aa01a3b None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:50.414286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1cef4-56e3-4617-89c8-9d292aa01a3b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:50.414286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1cef4-56e3-4617-89c8-9d292aa01a3b None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:50.416294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 695/1395] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:50.423724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abab63-2d51-4e88-8228-dc110f4ebbf2 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:50.424248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abab63-2d51-4e88-8228-dc110f4ebbf2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:50.424529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abab63-2d51-4e88-8228-dc110f4ebbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:50.443372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-63abab63-2d51-4e88-8228-dc110f4ebbf2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:50.444561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-63abab63-2d51-4e88-8228-dc110f4ebbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:50.452392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 701/1396] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:50.491571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1cef4-56e3-4617-89c8-9d292aa01a3b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:50.502578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1cef4-56e3-4617-89c8-9d292aa01a3b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:50.506330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8b469-3208-4680-ae30-fd892b5d84b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:50.506963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b469-3208-4680-ae30-fd892b5d84b8 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:50.507239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b469-3208-4680-ae30-fd892b5d84b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:50.507507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b469-3208-4680-ae30-fd892b5d84b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:50.517485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8b469-3208-4680-ae30-fd892b5d84b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:50.518915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8b469-3208-4680-ae30-fd892b5d84b8 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:50.529065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 696/1397] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:52.724427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cdd6-b7d6-42be-acfb-532a302fc4c4 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:52.725288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cdd6-b7d6-42be-acfb-532a302fc4c4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:52.725446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cdd6-b7d6-42be-acfb-532a302fc4c4 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:52.727352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 702/1398] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:52.733387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06698bc-509c-4506-8754-b9c7f5a2368c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:52.733815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06698bc-509c-4506-8754-b9c7f5a2368c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:52.733920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06698bc-509c-4506-8754-b9c7f5a2368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:52.751376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d06698bc-509c-4506-8754-b9c7f5a2368c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:52.752562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d06698bc-509c-4506-8754-b9c7f5a2368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:52.759616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 697/1399] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:52.798745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52cdd6-b7d6-42be-acfb-532a302fc4c4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:52.800366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8f52cdd6-b7d6-42be-acfb-532a302fc4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:52.812975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52cdd6-b7d6-42be-acfb-532a302fc4c4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:52.816237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f50948-cea4-4814-89c3-cdb90be7dcce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:52.816861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50948-cea4-4814-89c3-cdb90be7dcce service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:52.817141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50948-cea4-4814-89c3-cdb90be7dcce service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:52.817414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50948-cea4-4814-89c3-cdb90be7dcce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:52.825728 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f50948-cea4-4814-89c3-cdb90be7dcce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:52.827693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f50948-cea4-4814-89c3-cdb90be7dcce service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:52.836340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 703/1400] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:31:55.155504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cea0-afa4-4b34-b5ea-bb419571cf35 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:55.156022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cea0-afa4-4b34-b5ea-bb419571cf35 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:55.156120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cea0-afa4-4b34-b5ea-bb419571cf35 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:55.157917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 698/1401] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:55.163680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea4d3-2451-4f8b-92cf-5a3b05c91f02 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:55.164163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea4d3-2451-4f8b-92cf-5a3b05c91f02 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:55.164262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea4d3-2451-4f8b-92cf-5a3b05c91f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:55.182140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b31ea4d3-2451-4f8b-92cf-5a3b05c91f02 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:55.183310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b31ea4d3-2451-4f8b-92cf-5a3b05c91f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:55.191005 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 704/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:55.229741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0cea0-afa4-4b34-b5ea-bb419571cf35 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:55.240072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0cea0-afa4-4b34-b5ea-bb419571cf35 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:55.243369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ffcb-a07a-4ed2-b50d-9974b602ce39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:55.244031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ffcb-a07a-4ed2-b50d-9974b602ce39 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:55.244309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ffcb-a07a-4ed2-b50d-9974b602ce39 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:55.244576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ffcb-a07a-4ed2-b50d-9974b602ce39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:55.253206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054ffcb-a07a-4ed2-b50d-9974b602ce39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:55.254607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054ffcb-a07a-4ed2-b50d-9974b602ce39 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:55.262954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 699/1403] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:57.426348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977887ac-5a0e-4748-9e18-20e60b3e443c None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:57.426866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977887ac-5a0e-4748-9e18-20e60b3e443c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:57.426866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977887ac-5a0e-4748-9e18-20e60b3e443c None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:57.428686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 705/1404] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:57.434687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9d013-10b6-4180-adbf-161fd4a9bade None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:57.435134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9d013-10b6-4180-adbf-161fd4a9bade None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:57.435951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9d013-10b6-4180-adbf-161fd4a9bade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:57.452931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-7fa9d013-10b6-4180-adbf-161fd4a9bade None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:57.454245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7fa9d013-10b6-4180-adbf-161fd4a9bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:57.461535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 700/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:31:57.500278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977887ac-5a0e-4748-9e18-20e60b3e443c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:57.510308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977887ac-5a0e-4748-9e18-20e60b3e443c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:57.513640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e85d48-f29f-48be-a272-88dbabea87c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:57.514319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85d48-f29f-48be-a272-88dbabea87c8 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:57.514599 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85d48-f29f-48be-a272-88dbabea87c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:57.514925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85d48-f29f-48be-a272-88dbabea87c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:57.523110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e85d48-f29f-48be-a272-88dbabea87c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:57.524558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e85d48-f29f-48be-a272-88dbabea87c8 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:57.533127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 706/1406] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:59.692517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407844-3a60-433e-960a-d60061e2acc0 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:59.693085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407844-3a60-433e-960a-d60061e2acc0 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:59.693085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407844-3a60-433e-960a-d60061e2acc0 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:59.694809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 701/1407] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:31:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:31:59.700593 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe56a-590a-4a79-a55f-5f60671aab75 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:59.701597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe56a-590a-4a79-a55f-5f60671aab75 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:59.701912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe56a-590a-4a79-a55f-5f60671aab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:59.719808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-5ecbe56a-590a-4a79-a55f-5f60671aab75 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:31:59.720955 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5ecbe56a-590a-4a79-a55f-5f60671aab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:31:59.728056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 707/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:31:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:31:59.765772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407844-3a60-433e-960a-d60061e2acc0 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:31:59.775889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407844-3a60-433e-960a-d60061e2acc0 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:31:59.780074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7af53f-3589-45c7-9340-75aeaba0176e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:31:59.780708 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af53f-3589-45c7-9340-75aeaba0176e service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:31:59.780986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af53f-3589-45c7-9340-75aeaba0176e service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:31:59.781283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af53f-3589-45c7-9340-75aeaba0176e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:31:59.789585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7af53f-3589-45c7-9340-75aeaba0176e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:31:59.791018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7af53f-3589-45c7-9340-75aeaba0176e service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:31:59.799641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 702/1409] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:31:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:32:01.964142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dc02-1099-49fd-b607-e546304c1b0f None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:01.964710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dc02-1099-49fd-b607-e546304c1b0f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:01.964710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dc02-1099-49fd-b607-e546304c1b0f None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:01.966853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 708/1410] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:32:01.972667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c624-390b-4928-93f4-9078269126af None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:01.973081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c624-390b-4928-93f4-9078269126af None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:01.973232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c624-390b-4928-93f4-9078269126af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:01.990929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2663c624-390b-4928-93f4-9078269126af None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:01.992124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2663c624-390b-4928-93f4-9078269126af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:01.999832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 703/1411] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:32:02.037634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9dc02-1099-49fd-b607-e546304c1b0f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:02.048302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9dc02-1099-49fd-b607-e546304c1b0f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:02.051733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde60c1-049f-4a53-8cde-b175c19a906c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:02.052358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde60c1-049f-4a53-8cde-b175c19a906c service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:02.052635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde60c1-049f-4a53-8cde-b175c19a906c service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:02.052904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde60c1-049f-4a53-8cde-b175c19a906c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:02.061638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde60c1-049f-4a53-8cde-b175c19a906c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:02.063261 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde60c1-049f-4a53-8cde-b175c19a906c service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:02.072091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 709/1412] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:32:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:32:04.227619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55405-b1f5-40e8-a8ad-d27009ced81d None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:04.228208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55405-b1f5-40e8-a8ad-d27009ced81d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:04.228208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55405-b1f5-40e8-a8ad-d27009ced81d None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:04.229951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 704/1413] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:04.236271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c1669-a55a-4ded-a6f8-081cca0ac599 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:04.236689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c1669-a55a-4ded-a6f8-081cca0ac599 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:04.236823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c1669-a55a-4ded-a6f8-081cca0ac599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:04.254778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f87c1669-a55a-4ded-a6f8-081cca0ac599 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:04.255950 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f87c1669-a55a-4ded-a6f8-081cca0ac599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:04.263450 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 710/1414] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:32:04.300644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb55405-b1f5-40e8-a8ad-d27009ced81d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:04.310561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb55405-b1f5-40e8-a8ad-d27009ced81d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:04.313873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017eb81-d910-4ca6-bb16-a67a52613b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:04.314496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017eb81-d910-4ca6-bb16-a67a52613b1b service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:04.314774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017eb81-d910-4ca6-bb16-a67a52613b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:04.315041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017eb81-d910-4ca6-bb16-a67a52613b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:04.323136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017eb81-d910-4ca6-bb16-a67a52613b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:04.324583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017eb81-d910-4ca6-bb16-a67a52613b1b service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:04.333653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 705/1415] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:32:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:32:22.795080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaff67-e5fa-4bbb-bfb8-8c0e9e875b45 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:22.795632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaff67-e5fa-4bbb-bfb8-8c0e9e875b45 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:22.795632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaff67-e5fa-4bbb-bfb8-8c0e9e875b45 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:22.797353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 711/1416] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:22.803234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921caf9-1d20-4864-a464-986050bdf8bc None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:22.803640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921caf9-1d20-4864-a464-986050bdf8bc None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:22.803817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921caf9-1d20-4864-a464-986050bdf8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:22.821261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9921caf9-1d20-4864-a464-986050bdf8bc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:22.822408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9921caf9-1d20-4864-a464-986050bdf8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:22.829670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 706/1417] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:32:22.877589 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489619d-4107-45e6-a42b-a420adb45662 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:22.877879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489619d-4107-45e6-a42b-a420adb45662 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:22.878166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489619d-4107-45e6-a42b-a420adb45662 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:22.880000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 712/1418] 10.222.0.16 () {54 vars in 966 bytes} [Wed Jul 28 03:32:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:22.885322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37029698-53bc-4548-a634-0233b9d7d5f7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:22.885636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37029698-53bc-4548-a634-0233b9d7d5f7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:22.885917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37029698-53bc-4548-a634-0233b9d7d5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:22.903109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-37029698-53bc-4548-a634-0233b9d7d5f7 None None] MFA Rules not processed for user `b8eb54ff54264f309aa5949ed8aef453`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:22.904284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-37029698-53bc-4548-a634-0233b9d7d5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:22.910207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 707/1419] 10.222.0.16 () {58 vars in 1064 bytes} [Wed Jul 28 03:32:22 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:32:22.917747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489619d-4107-45e6-a42b-a420adb45662 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:22.928570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489619d-4107-45e6-a42b-a420adb45662 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:22.931884 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d217a8-1e23-46e2-90bc-143f1dd30fa8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:22.932514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d217a8-1e23-46e2-90bc-143f1dd30fa8 service glance] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:22.932795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d217a8-1e23-46e2-90bc-143f1dd30fa8 service glance] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:22.933100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d217a8-1e23-46e2-90bc-143f1dd30fa8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:22.942086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d217a8-1e23-46e2-90bc-143f1dd30fa8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:22.943511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d217a8-1e23-46e2-90bc-143f1dd30fa8 service glance] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:22.952174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 713/1420] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:32:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:32:25.171297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edca53-dc26-4fa9-b499-c6296660b6c2 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:25.171920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edca53-dc26-4fa9-b499-c6296660b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:25.171920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edca53-dc26-4fa9-b499-c6296660b6c2 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:25.173698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 708/1421] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:25.179783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dadb3-38b4-4194-b379-5749f3e6d34d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:25.180233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dadb3-38b4-4194-b379-5749f3e6d34d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:25.180347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dadb3-38b4-4194-b379-5749f3e6d34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:25.197754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8d5dadb3-38b4-4194-b379-5749f3e6d34d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:25.198905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8d5dadb3-38b4-4194-b379-5749f3e6d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:25.206131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 714/1422] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:32:25.230189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edca53-dc26-4fa9-b499-c6296660b6c2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:25.242089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edca53-dc26-4fa9-b499-c6296660b6c2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:25.246369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f8223-7b4f-4c71-a0fa-8a7d7f57d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:25.247749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f8223-7b4f-4c71-a0fa-8a7d7f57d44d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:25.248018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f8223-7b4f-4c71-a0fa-8a7d7f57d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:25.248236 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f8223-7b4f-4c71-a0fa-8a7d7f57d44d admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:25.248970 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f8223-7b4f-4c71-a0fa-8a7d7f57d44d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:25.250808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f8223-7b4f-4c71-a0fa-8a7d7f57d44d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:25.264088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 709/1423] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 28 03:32:25 2021] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:32:27.470796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df619-6d27-4820-a747-0b56830345fd None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:27.471329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df619-6d27-4820-a747-0b56830345fd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:27.471329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df619-6d27-4820-a747-0b56830345fd None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:27.473151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 715/1424] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:27.479085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d66-e41f-4757-9804-c7f0d6317f55 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:27.479498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d66-e41f-4757-9804-c7f0d6317f55 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:27.479640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d66-e41f-4757-9804-c7f0d6317f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:27.498036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-62f30d66-e41f-4757-9804-c7f0d6317f55 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:27.499192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-62f30d66-e41f-4757-9804-c7f0d6317f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:27.506560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 710/1425] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:32:27.550307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df619-6d27-4820-a747-0b56830345fd None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:27.564042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df619-6d27-4820-a747-0b56830345fd None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:27.569072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656c07f-f3de-45c4-b2ad-4222297c4855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:27.569700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c07f-f3de-45c4-b2ad-4222297c4855 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:27.569980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c07f-f3de-45c4-b2ad-4222297c4855 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:27.570254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c07f-f3de-45c4-b2ad-4222297c4855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:27.577944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656c07f-f3de-45c4-b2ad-4222297c4855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:27.579504 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656c07f-f3de-45c4-b2ad-4222297c4855 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:27.588151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 716/1426] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:32:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:32:29.891677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728359c-1d30-45f9-888b-37dff29bc6e4 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:29.892265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728359c-1d30-45f9-888b-37dff29bc6e4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:29.892265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728359c-1d30-45f9-888b-37dff29bc6e4 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:29.894072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 711/1427] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:29.899858 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d8548-6798-415e-967a-a8ab557547f4 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:29.900265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d8548-6798-415e-967a-a8ab557547f4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:29.900451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d8548-6798-415e-967a-a8ab557547f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:29.918347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c18d8548-6798-415e-967a-a8ab557547f4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:29.919516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c18d8548-6798-415e-967a-a8ab557547f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:29.926563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 717/1428] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:32:29.962861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728359c-1d30-45f9-888b-37dff29bc6e4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:29.973765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728359c-1d30-45f9-888b-37dff29bc6e4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:29.977096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c9c7a-3112-4aca-bdc6-07f0cd3de937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:29.977724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9c7a-3112-4aca-bdc6-07f0cd3de937 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:29.978006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9c7a-3112-4aca-bdc6-07f0cd3de937 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:29.978279 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9c7a-3112-4aca-bdc6-07f0cd3de937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:29.986484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c9c7a-3112-4aca-bdc6-07f0cd3de937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:29.987943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c9c7a-3112-4aca-bdc6-07f0cd3de937 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:29.996575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 712/1429] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:32:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:32:32.211229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b2d3f-3439-410c-b9d6-57ad568f5ebd None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:32.211829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b2d3f-3439-410c-b9d6-57ad568f5ebd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:32.211829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b2d3f-3439-410c-b9d6-57ad568f5ebd None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:32.213565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 718/1430] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:32.220709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d172b45-0810-4433-a3d2-fdad6149f11b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:32.221136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d172b45-0810-4433-a3d2-fdad6149f11b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:32.221260 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d172b45-0810-4433-a3d2-fdad6149f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:32.238928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0d172b45-0810-4433-a3d2-fdad6149f11b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:32.240089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0d172b45-0810-4433-a3d2-fdad6149f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:32.247854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 713/1431] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:32:32.285712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b2d3f-3439-410c-b9d6-57ad568f5ebd None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:32.296372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b2d3f-3439-410c-b9d6-57ad568f5ebd None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:32.299636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6be41-7aaa-4169-86b7-1a8a2221bf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:32.300295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6be41-7aaa-4169-86b7-1a8a2221bf1d service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:32.300573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6be41-7aaa-4169-86b7-1a8a2221bf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:32.300842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6be41-7aaa-4169-86b7-1a8a2221bf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:32.309073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6be41-7aaa-4169-86b7-1a8a2221bf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:32.311099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6be41-7aaa-4169-86b7-1a8a2221bf1d service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:32.319610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 719/1432] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:32:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:32:34.594120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562198c4-3408-4286-81af-02df7e075e84 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:34.594663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562198c4-3408-4286-81af-02df7e075e84 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:34.594663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562198c4-3408-4286-81af-02df7e075e84 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:34.596457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 714/1433] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:34.602355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fac0a-26a1-44ea-8444-5850fd862148 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:34.602794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fac0a-26a1-44ea-8444-5850fd862148 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:34.602898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fac0a-26a1-44ea-8444-5850fd862148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:34.620463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a34fac0a-26a1-44ea-8444-5850fd862148 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:34.621619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a34fac0a-26a1-44ea-8444-5850fd862148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:34.628840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 720/1434] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:32:34.670243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562198c4-3408-4286-81af-02df7e075e84 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:34.680079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562198c4-3408-4286-81af-02df7e075e84 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:34.683284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b520b-0796-4961-8aa3-d790a18ff85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:34.683942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b520b-0796-4961-8aa3-d790a18ff85e service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:34.684223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b520b-0796-4961-8aa3-d790a18ff85e service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:34.684495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b520b-0796-4961-8aa3-d790a18ff85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:34.692549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b520b-0796-4961-8aa3-d790a18ff85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:34.693963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b520b-0796-4961-8aa3-d790a18ff85e service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:34.702453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 715/1435] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:32:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:32:37.090311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660977-f3b8-40d9-928a-69811e1dd23b None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:37.090879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660977-f3b8-40d9-928a-69811e1dd23b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:37.090992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660977-f3b8-40d9-928a-69811e1dd23b None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:37.093069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 721/1436] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 28 03:32:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:32:37.098944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a1f9-6c14-4ee5-ba03-95108739e850 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:37.099391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a1f9-6c14-4ee5-ba03-95108739e850 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:37.099501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a1f9-6c14-4ee5-ba03-95108739e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:37.116921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8dc0a1f9-6c14-4ee5-ba03-95108739e850 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:32:37.118057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8dc0a1f9-6c14-4ee5-ba03-95108739e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:32:37.126209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 716/1437] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Jul 28 03:32:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:32:37.166039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52660977-f3b8-40d9-928a-69811e1dd23b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:32:37.176974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52660977-f3b8-40d9-928a-69811e1dd23b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:32:37.180338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef25c19-8b47-43f5-9aa4-e82ed02939dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:32:37.180971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef25c19-8b47-43f5-9aa4-e82ed02939dd service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:32:37.181251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef25c19-8b47-43f5-9aa4-e82ed02939dd service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:32:37.181524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef25c19-8b47-43f5-9aa4-e82ed02939dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:32:37.189802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef25c19-8b47-43f5-9aa4-e82ed02939dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:32:37.191232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef25c19-8b47-43f5-9aa4-e82ed02939dd service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:32:37.199661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 722/1438] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:32:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:33:47.928569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7cf92-c259-4839-bef2-49e999d84881 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:47.930151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7cf92-c259-4839-bef2-49e999d84881 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:47.930151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7cf92-c259-4839-bef2-49e999d84881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:47.947023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-40b7cf92-c259-4839-bef2-49e999d84881 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:33:47.948215 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-40b7cf92-c259-4839-bef2-49e999d84881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:33:47.955266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 717/1439] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:33:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:33:47.963064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8fb66-80ff-4062-8ec1-e0c4e4bbcfae None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:47.963528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8fb66-80ff-4062-8ec1-e0c4e4bbcfae None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:47.963638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8fb66-80ff-4062-8ec1-e0c4e4bbcfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:47.981499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-7ba8fb66-80ff-4062-8ec1-e0c4e4bbcfae None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:33:47.982647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7ba8fb66-80ff-4062-8ec1-e0c4e4bbcfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:33:47.989827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 723/1440] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:33:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:33:47.994083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7cf92-c259-4839-bef2-49e999d84881 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.003447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7cf92-c259-4839-bef2-49e999d84881 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.007733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.008384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.008667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.008944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.009663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:33:48.009967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.011574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.022975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 718/1441] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:33:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:33:48.030949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8fb66-80ff-4062-8ec1-e0c4e4bbcfae None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.039194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8fb66-80ff-4062-8ec1-e0c4e4bbcfae None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.043938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dcfe-4485-4b38-af80-abef9d61ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.044575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dcfe-4485-4b38-af80-abef9d61ba44 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.044855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dcfe-4485-4b38-af80-abef9d61ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.045124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dcfe-4485-4b38-af80-abef9d61ba44 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.045809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59dcfe-4485-4b38-af80-abef9d61ba44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.047752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59dcfe-4485-4b38-af80-abef9d61ba44 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.083936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 724/1442] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:33:48 2021] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:33:48.087996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.097669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20509e70-f55f-4726-9735-8ab8ebe745ab admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.150209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a3d1a-e9b0-4669-9d65-d99832598c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.150876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a3d1a-e9b0-4669-9d65-d99832598c5d admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.151153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a3d1a-e9b0-4669-9d65-d99832598c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.151423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a3d1a-e9b0-4669-9d65-d99832598c5d admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.152622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a3d1a-e9b0-4669-9d65-d99832598c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.154525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a3d1a-e9b0-4669-9d65-d99832598c5d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.174408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 719/1443] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:33:48 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:33:48.178460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dcfe-4485-4b38-af80-abef9d61ba44 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.188416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dcfe-4485-4b38-af80-abef9d61ba44 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.192619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b93ed-4934-47f1-b87a-ac68c6d603ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.193271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b93ed-4934-47f1-b87a-ac68c6d603ac admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.193549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b93ed-4934-47f1-b87a-ac68c6d603ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.193818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b93ed-4934-47f1-b87a-ac68c6d603ac admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.194528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b93ed-4934-47f1-b87a-ac68c6d603ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.196161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b93ed-4934-47f1-b87a-ac68c6d603ac admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.208470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 725/1444] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:33:48.212131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a3d1a-e9b0-4669-9d65-d99832598c5d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.221780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a3d1a-e9b0-4669-9d65-d99832598c5d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.225890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e8d8a-d8ef-42c8-803d-e89a4e8d2f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.226538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8d8a-d8ef-42c8-803d-e89a4e8d2f09 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.226813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8d8a-d8ef-42c8-803d-e89a4e8d2f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.227082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8d8a-d8ef-42c8-803d-e89a4e8d2f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.227816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e8d8a-d8ef-42c8-803d-e89a4e8d2f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.229393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e8d8a-d8ef-42c8-803d-e89a4e8d2f09 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.242731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 720/1445] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:33:48.247585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b93ed-4934-47f1-b87a-ac68c6d603ac admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.257074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b93ed-4934-47f1-b87a-ac68c6d603ac admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.262309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0db28-5a68-4cc1-93a6-672c46dbe917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.263175 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0db28-5a68-4cc1-93a6-672c46dbe917 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.263454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0db28-5a68-4cc1-93a6-672c46dbe917 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.263751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0db28-5a68-4cc1-93a6-672c46dbe917 admin admin] PATH_INFO: `/v3/projects/929c35c336a14d8ea5e35a42c504afbf/users/3013af54e0454a4b87ca105ffc0d010f/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.277929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0db28-5a68-4cc1-93a6-672c46dbe917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929c35c336a14d8ea5e35a42c504afbf, user_id=3013af54e0454a4b87ca105ffc0d010f, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.280675 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0db28-5a68-4cc1-93a6-672c46dbe917 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.293151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 726/1446] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:33:48 2021] PUT /identity/v3/projects/929c35c336a14d8ea5e35a42c504afbf/users/3013af54e0454a4b87ca105ffc0d010f/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:33:48.304943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f8e1-e4fa-425a-8d44-81793dd6eeb1 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.305234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f8e1-e4fa-425a-8d44-81793dd6eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.305508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f8e1-e4fa-425a-8d44-81793dd6eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.331787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0041f8e1-e4fa-425a-8d44-81793dd6eeb1 None None] MFA Rules not processed for user `3013af54e0454a4b87ca105ffc0d010f`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:33:48.332960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0041f8e1-e4fa-425a-8d44-81793dd6eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:33:48.393274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 721/1447] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:33:48 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:33:48.405116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0db28-5a68-4cc1-93a6-672c46dbe917 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.470853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0db28-5a68-4cc1-93a6-672c46dbe917 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.475846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3372e9-c215-49f1-b61e-228ce11bb08f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.476483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3372e9-c215-49f1-b61e-228ce11bb08f service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.476766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3372e9-c215-49f1-b61e-228ce11bb08f service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.477041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3372e9-c215-49f1-b61e-228ce11bb08f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.485037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3372e9-c215-49f1-b61e-228ce11bb08f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.486624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3372e9-c215-49f1-b61e-228ce11bb08f service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.494629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 727/1448] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:33:48 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:33:48.562740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac2ec-b6f7-4c51-954a-c0a14db88658 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.563031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac2ec-b6f7-4c51-954a-c0a14db88658 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.563306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac2ec-b6f7-4c51-954a-c0a14db88658 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.565046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 722/1449] 10.222.0.16 () {52 vars in 829 bytes} [Wed Jul 28 03:33:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:33:48.568579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3372e9-c215-49f1-b61e-228ce11bb08f service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.626838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3372e9-c215-49f1-b61e-228ce11bb08f service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.631128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.632046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.632330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.632627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] PATH_INFO: `/v3/users/3013af54e0454a4b87ca105ffc0d010f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.633769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3013af54e0454a4b87ca105ffc0d010f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.634784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:33:48.634784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:33:48.634784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:33:48.636064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.711326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3013af54e0454a4b87ca105ffc0d010f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:48.730711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3013af54e0454a4b87ca105ffc0d010f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:48.731365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3013af54e0454a4b87ca105ffc0d010f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:48.740330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3013af54e0454a4b87ca105ffc0d010f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:48.741008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3013af54e0454a4b87ca105ffc0d010f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:48.758945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 728/1450] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:33:48 2021] DELETE /identity/v3/users/3013af54e0454a4b87ca105ffc0d010f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:33:48.763510 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597d71-4717-4781-9345-0b59d0b9543d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.763823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597d71-4717-4781-9345-0b59d0b9543d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.764101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597d71-4717-4781-9345-0b59d0b9543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.780913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6a597d71-4717-4781-9345-0b59d0b9543d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:33:48.782104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6a597d71-4717-4781-9345-0b59d0b9543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:33:48.835988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 723/1451] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:33:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:33:48.847461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:48.848830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:33:48.903057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0623d9-22a5-47fd-8e2d-594c8733c763 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:48.906504 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd980279-b9af-45f7-83ac-681c96ef55a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:48.907142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980279-b9af-45f7-83ac-681c96ef55a4 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:48.907432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980279-b9af-45f7-83ac-681c96ef55a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:48.907697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980279-b9af-45f7-83ac-681c96ef55a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:48.916076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd980279-b9af-45f7-83ac-681c96ef55a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:48.918188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd980279-b9af-45f7-83ac-681c96ef55a4 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:48.926726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 729/1452] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:33:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:33:49.275624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a597d71-4717-4781-9345-0b59d0b9543d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:33:49.278534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6a597d71-4717-4781-9345-0b59d0b9543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:33:49.289211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a597d71-4717-4781-9345-0b59d0b9543d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:33:49.294499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:33:49.295783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:33:49.296063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:33:49.296330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] PATH_INFO: `/v3/projects/929c35c336a14d8ea5e35a42c504afbf` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:33:49.297468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929c35c336a14d8ea5e35a42c504afbf)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:33:49.298513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:33:49.298513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:33:49.298513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:33:49.300553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:33:49.359776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929c35c336a14d8ea5e35a42c504afbf', 'request_id': 'req-a9077d2e-c378-4600-ad22-39c9bfc404c4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:49.373443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929c35c336a14d8ea5e35a42c504afbf', 'request_id': 'req-a9077d2e-c378-4600-ad22-39c9bfc404c4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:49.383068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929c35c336a14d8ea5e35a42c504afbf', 'request_id': 'req-a9077d2e-c378-4600-ad22-39c9bfc404c4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:49.394402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] The token cache is being invalidate because project 929c35c336a14d8ea5e35a42c504afbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:33:49.394683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:49.395299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a9077d2e-c378-4600-ad22-39c9bfc404c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:33:49.396915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 724/1453] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:33:49 2021] DELETE /identity/v3/projects/929c35c336a14d8ea5e35a42c504afbf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:35:18.457240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee829-b86e-4b79-bd8e-db0889636d65 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:18.457821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee829-b86e-4b79-bd8e-db0889636d65 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:18.457821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee829-b86e-4b79-bd8e-db0889636d65 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:18.459488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 28 03:35:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:18.465345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766befb-4081-4d98-8aa7-9c2fe4fe17f3 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:18.465825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766befb-4081-4d98-8aa7-9c2fe4fe17f3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:18.466322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766befb-4081-4d98-8aa7-9c2fe4fe17f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:18.489490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1766befb-4081-4d98-8aa7-9c2fe4fe17f3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:18.490654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1766befb-4081-4d98-8aa7-9c2fe4fe17f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:18.545476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 999 bytes} [Wed Jul 28 03:35:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:35:18.704134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ee829-b86e-4b79-bd8e-db0889636d65 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:18.705852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-931ee829-b86e-4b79-bd8e-db0889636d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:18.780382 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ee829-b86e-4b79-bd8e-db0889636d65 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:18.781599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f6d5-3262-4141-9021-6b0f76ef87de None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:18.781900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f6d5-3262-4141-9021-6b0f76ef87de None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:18.782179 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f6d5-3262-4141-9021-6b0f76ef87de None None] PATH_INFO: `/v3` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:18.783467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 726/1456] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 28 03:35:18 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:35:18.785462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8ac55-353a-4921-985f-68e284dddd11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:18.786099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ac55-353a-4921-985f-68e284dddd11 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:18.786376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ac55-353a-4921-985f-68e284dddd11 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:18.786647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ac55-353a-4921-985f-68e284dddd11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:18.789838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a7b0-42fa-49b5-a3c9-45fbec40deee None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:18.790125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a7b0-42fa-49b5-a3c9-45fbec40deee None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:18.790404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a7b0-42fa-49b5-a3c9-45fbec40deee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:18.795315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8ac55-353a-4921-985f-68e284dddd11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:18.796999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8ac55-353a-4921-985f-68e284dddd11 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:18.806106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 731/1457] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:35:18.808342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5861a7b0-42fa-49b5-a3c9-45fbec40deee None None] MFA Rules not processed for user `d2b5335392b4400d94f1dfce0e010b74`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:18.809520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5861a7b0-42fa-49b5-a3c9-45fbec40deee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:18.871987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 727/1458] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Jul 28 03:35:18 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:35:20.152478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a212-c45b-48f5-8c75-e159ed9b3f19 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:20.152945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a212-c45b-48f5-8c75-e159ed9b3f19 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:20.153061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a212-c45b-48f5-8c75-e159ed9b3f19 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:20.154818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 28 03:35:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:20.160210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f21108-a2de-402a-a3bf-fbf93503857f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:20.160616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f21108-a2de-402a-a3bf-fbf93503857f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:20.160770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f21108-a2de-402a-a3bf-fbf93503857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:20.178262 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-03f21108-a2de-402a-a3bf-fbf93503857f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:20.179429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-03f21108-a2de-402a-a3bf-fbf93503857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:20.186669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 999 bytes} [Wed Jul 28 03:35:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:35:20.338560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a212-c45b-48f5-8c75-e159ed9b3f19 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:20.352165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a212-c45b-48f5-8c75-e159ed9b3f19 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:20.357282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9124-441c-4e4e-ac98-b639f992aabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:20.357915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9124-441c-4e4e-ac98-b639f992aabf service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:20.358200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9124-441c-4e4e-ac98-b639f992aabf service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:20.358478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9124-441c-4e4e-ac98-b639f992aabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:20.370255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9124-441c-4e4e-ac98-b639f992aabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:20.372652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9124-441c-4e4e-ac98-b639f992aabf service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:20.381265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 733/1461] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:35:27.256658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e90e8-483e-48eb-89b0-3f2a051dd159 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:27.257138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e90e8-483e-48eb-89b0-3f2a051dd159 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:27.257251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e90e8-483e-48eb-89b0-3f2a051dd159 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:27.258958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 729/1462] 10.222.0.16 () {54 vars in 960 bytes} [Wed Jul 28 03:35:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:27.264324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6810-0b27-4dcb-a162-fe316c679c90 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:27.264724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6810-0b27-4dcb-a162-fe316c679c90 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:27.264877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6810-0b27-4dcb-a162-fe316c679c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:27.283016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-791d6810-0b27-4dcb-a162-fe316c679c90 None None] MFA Rules not processed for user `d2b5335392b4400d94f1dfce0e010b74`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:27.284200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-791d6810-0b27-4dcb-a162-fe316c679c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:27.292006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 734/1463] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jul 28 03:35:27 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:35:27.300390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e90e8-483e-48eb-89b0-3f2a051dd159 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:27.312527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e90e8-483e-48eb-89b0-3f2a051dd159 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:27.317295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b1a11-e6e8-4975-9501-1bb851f6633c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:27.317929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1a11-e6e8-4975-9501-1bb851f6633c service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:27.318234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1a11-e6e8-4975-9501-1bb851f6633c service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:27.318505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1a11-e6e8-4975-9501-1bb851f6633c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:27.326256 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b1a11-e6e8-4975-9501-1bb851f6633c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:27.327864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b1a11-e6e8-4975-9501-1bb851f6633c service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:27.336405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 730/1464] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:27 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:35:32.162718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2a30-ce72-4012-a09c-b75755db3d65 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:32.163225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2a30-ce72-4012-a09c-b75755db3d65 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:32.163330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2a30-ce72-4012-a09c-b75755db3d65 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:32.165101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 28 03:35:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:32.170944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa108f5-17a6-4c05-b835-97fd2fd8a33a None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:32.171393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa108f5-17a6-4c05-b835-97fd2fd8a33a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:32.171489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa108f5-17a6-4c05-b835-97fd2fd8a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:32.188686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2fa108f5-17a6-4c05-b835-97fd2fd8a33a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:32.189982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2fa108f5-17a6-4c05-b835-97fd2fd8a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:32.196951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 999 bytes} [Wed Jul 28 03:35:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:35:32.350885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c2a30-ce72-4012-a09c-b75755db3d65 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:32.364327 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c2a30-ce72-4012-a09c-b75755db3d65 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:32.369410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4617d-1407-4958-b40f-356f153dc7be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:32.370067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4617d-1407-4958-b40f-356f153dc7be service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:32.370368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4617d-1407-4958-b40f-356f153dc7be service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:32.370626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4617d-1407-4958-b40f-356f153dc7be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:32.378896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4617d-1407-4958-b40f-356f153dc7be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:32.380462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4617d-1407-4958-b40f-356f153dc7be service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:32.389648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 736/1467] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:35:33.727411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc1ca-a655-44ec-a9f4-5029a85eacd1 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:33.727959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc1ca-a655-44ec-a9f4-5029a85eacd1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:33.727959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc1ca-a655-44ec-a9f4-5029a85eacd1 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:33.729735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 28 03:35:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:33.735500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1973a-4921-46ee-a13b-4edd16a2559b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:33.735932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1973a-4921-46ee-a13b-4edd16a2559b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:33.736116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1973a-4921-46ee-a13b-4edd16a2559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:33.754335 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a7f1973a-4921-46ee-a13b-4edd16a2559b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:33.755478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a7f1973a-4921-46ee-a13b-4edd16a2559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:33.762977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 999 bytes} [Wed Jul 28 03:35:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:35:33.919009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bc1ca-a655-44ec-a9f4-5029a85eacd1 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:33.932178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bc1ca-a655-44ec-a9f4-5029a85eacd1 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:33.937332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff787dd-c545-4e90-8f4f-34c1286c4355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:33.937957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff787dd-c545-4e90-8f4f-34c1286c4355 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:33.938235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff787dd-c545-4e90-8f4f-34c1286c4355 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:33.938505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff787dd-c545-4e90-8f4f-34c1286c4355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:33.945899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff787dd-c545-4e90-8f4f-34c1286c4355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:33.947478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff787dd-c545-4e90-8f4f-34c1286c4355 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:33.956085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 733/1470] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:35:38.221396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46514d1b-bf1b-41ee-b474-1a10bc2c03cd None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:38.221947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46514d1b-bf1b-41ee-b474-1a10bc2c03cd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:38.221947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46514d1b-bf1b-41ee-b474-1a10bc2c03cd None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:38.223743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 738/1471] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 28 03:35:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:38.229450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b018-d87a-4e4f-ba53-907aefaf66f0 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:38.229857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b018-d87a-4e4f-ba53-907aefaf66f0 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:38.230008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b018-d87a-4e4f-ba53-907aefaf66f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:38.248514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c423b018-d87a-4e4f-ba53-907aefaf66f0 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:38.249666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c423b018-d87a-4e4f-ba53-907aefaf66f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:38.256890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 734/1472] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Jul 28 03:35:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:35:38.294853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46514d1b-bf1b-41ee-b474-1a10bc2c03cd None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:38.296510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-46514d1b-bf1b-41ee-b474-1a10bc2c03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:38.350138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46514d1b-bf1b-41ee-b474-1a10bc2c03cd None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:38.353518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7751f-fb32-4b2a-947f-b2490db88cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:38.354153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7751f-fb32-4b2a-947f-b2490db88cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:38.354441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7751f-fb32-4b2a-947f-b2490db88cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:38.354716 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7751f-fb32-4b2a-947f-b2490db88cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:38.363822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7751f-fb32-4b2a-947f-b2490db88cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:38.365245 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7751f-fb32-4b2a-947f-b2490db88cb7 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:38.373856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 739/1473] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:35:40.506601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee15dc1-56a2-4179-a982-718ebe8f123d None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:40.507188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee15dc1-56a2-4179-a982-718ebe8f123d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:40.507188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee15dc1-56a2-4179-a982-718ebe8f123d None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:40.508905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 735/1474] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 28 03:35:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:40.514841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1692-05f8-4410-a50e-fad10ec0d2e1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:40.515282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1692-05f8-4410-a50e-fad10ec0d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:40.515388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1692-05f8-4410-a50e-fad10ec0d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:40.533206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ae1d1692-05f8-4410-a50e-fad10ec0d2e1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:40.534379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ae1d1692-05f8-4410-a50e-fad10ec0d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:40.541596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 740/1475] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Jul 28 03:35:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:35:40.578853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee15dc1-56a2-4179-a982-718ebe8f123d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:40.588903 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee15dc1-56a2-4179-a982-718ebe8f123d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:40.593661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd36d-f77b-43f8-9bd3-d6893fcd772f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:40.594306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd36d-f77b-43f8-9bd3-d6893fcd772f service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:40.594739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd36d-f77b-43f8-9bd3-d6893fcd772f service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:40.594870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd36d-f77b-43f8-9bd3-d6893fcd772f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:40.603341 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cd36d-f77b-43f8-9bd3-d6893fcd772f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:40.604793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cd36d-f77b-43f8-9bd3-d6893fcd772f service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:40.614144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 736/1476] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:35:44.423611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a122d-03e6-45fb-a13a-eaa262fe1852 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:44.424176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a122d-03e6-45fb-a13a-eaa262fe1852 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:44.424176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a122d-03e6-45fb-a13a-eaa262fe1852 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:44.425896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 741/1477] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 28 03:35:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:44.431570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de8fd-4e0b-4783-bd09-56ea1280cb45 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:44.431989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de8fd-4e0b-4783-bd09-56ea1280cb45 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:44.432144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de8fd-4e0b-4783-bd09-56ea1280cb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:44.450830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-cc5de8fd-4e0b-4783-bd09-56ea1280cb45 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:44.452001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cc5de8fd-4e0b-4783-bd09-56ea1280cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:44.459271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 737/1478] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Jul 28 03:35:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:35:44.513332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a122d-03e6-45fb-a13a-eaa262fe1852 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:44.514968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b10a122d-03e6-45fb-a13a-eaa262fe1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:44.571463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a122d-03e6-45fb-a13a-eaa262fe1852 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:44.575028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605fa95-9902-4a9b-9162-5ca419dbccbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:44.575657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605fa95-9902-4a9b-9162-5ca419dbccbf service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:44.575966 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605fa95-9902-4a9b-9162-5ca419dbccbf service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:44.576238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605fa95-9902-4a9b-9162-5ca419dbccbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:44.584660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605fa95-9902-4a9b-9162-5ca419dbccbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:44.586080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605fa95-9902-4a9b-9162-5ca419dbccbf service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:44.595882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 742/1479] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:35:46.713676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2fb3-213e-4451-9c04-6e504b71e32f None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:46.714204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2fb3-213e-4451-9c04-6e504b71e32f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:46.714335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2fb3-213e-4451-9c04-6e504b71e32f None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:46.716147 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 738/1480] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 28 03:35:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:46.722071 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf918e-a918-40fa-9b60-3dbde12d92fd None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:46.722474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf918e-a918-40fa-9b60-3dbde12d92fd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:46.722616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf918e-a918-40fa-9b60-3dbde12d92fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:46.739778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-7dcf918e-a918-40fa-9b60-3dbde12d92fd None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:46.740935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7dcf918e-a918-40fa-9b60-3dbde12d92fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:46.748730 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 743/1481] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Jul 28 03:35:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:35:46.800563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc8aad-e4e0-4149-8c50-68253654f338 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:46.800855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc8aad-e4e0-4149-8c50-68253654f338 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:46.801136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc8aad-e4e0-4149-8c50-68253654f338 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:46.802941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 739/1482] 10.222.0.16 () {54 vars in 963 bytes} [Wed Jul 28 03:35:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:35:46.808319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee553-14db-4c2e-9cf8-7895a9196ca6 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:46.809130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee553-14db-4c2e-9cf8-7895a9196ca6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:46.809950 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee553-14db-4c2e-9cf8-7895a9196ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:46.828259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-646ee553-14db-4c2e-9cf8-7895a9196ca6 None None] MFA Rules not processed for user `a02f0a6cbe5442da8bd2f78643d31aba`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:35:46.829397 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-646ee553-14db-4c2e-9cf8-7895a9196ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:35:46.835273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 744/1483] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jul 28 03:35:46 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:35:46.843804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc8aad-e4e0-4149-8c50-68253654f338 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:35:46.853639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc8aad-e4e0-4149-8c50-68253654f338 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:35:46.857151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848c703-2531-406f-ad46-b850cb42fd33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:35:46.857778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848c703-2531-406f-ad46-b850cb42fd33 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:35:46.858061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848c703-2531-406f-ad46-b850cb42fd33 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:35:46.858339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848c703-2531-406f-ad46-b850cb42fd33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:35:46.866656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848c703-2531-406f-ad46-b850cb42fd33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:35:46.868122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848c703-2531-406f-ad46-b850cb42fd33 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:35:46.877375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 740/1484] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:35:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:06.055152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dd5c-5e96-474e-9fa1-c926cae88697 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.056278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dd5c-5e96-474e-9fa1-c926cae88697 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.056818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dd5c-5e96-474e-9fa1-c926cae88697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.080869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-4b16dd5c-5e96-474e-9fa1-c926cae88697 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.082502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4b16dd5c-5e96-474e-9fa1-c926cae88697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.095968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 745/1485] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:06.104917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f899e-20b5-4290-9b70-e4ac9908df6e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.105487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f899e-20b5-4290-9b70-e4ac9908df6e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.105487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f899e-20b5-4290-9b70-e4ac9908df6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.108079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1522c-1f5b-45f7-b2d9-d47ae8e5f44e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.108378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1522c-1f5b-45f7-b2d9-d47ae8e5f44e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.108663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1522c-1f5b-45f7-b2d9-d47ae8e5f44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.130934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-076f899e-20b5-4290-9b70-e4ac9908df6e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.132150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-076f899e-20b5-4290-9b70-e4ac9908df6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.133972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b4f1522c-1f5b-45f7-b2d9-d47ae8e5f44e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.135127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b4f1522c-1f5b-45f7-b2d9-d47ae8e5f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.146986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 741/1486] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.151895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 746/1487] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:06.153959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f899e-20b5-4290-9b70-e4ac9908df6e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.162775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f899e-20b5-4290-9b70-e4ac9908df6e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.174275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426282b-a49c-4f3c-bd01-af679f25649b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.174588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426282b-a49c-4f3c-bd01-af679f25649b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.174849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426282b-a49c-4f3c-bd01-af679f25649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.176037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.176704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.176997 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.177246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.177975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:06.178277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.180147 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.208050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a426282b-a49c-4f3c-bd01-af679f25649b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.209223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a426282b-a49c-4f3c-bd01-af679f25649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.213108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 742/1488] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:06.221400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.232799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 747/1489] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 28 03:37:06.237038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb6f50-caa6-47e6-bd83-2bd7f84ba892 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.238526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426282b-a49c-4f3c-bd01-af679f25649b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.249238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513cbc4-cd56-44b2-aeba-3f7e6e75641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.249911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513cbc4-cd56-44b2-aeba-3f7e6e75641e admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.250193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513cbc4-cd56-44b2-aeba-3f7e6e75641e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.250467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513cbc4-cd56-44b2-aeba-3f7e6e75641e admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.252970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426282b-a49c-4f3c-bd01-af679f25649b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.253937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513cbc4-cd56-44b2-aeba-3f7e6e75641e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.255904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513cbc4-cd56-44b2-aeba-3f7e6e75641e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.265080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.265764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.266044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.266318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.267052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:06.267359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.269014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.295013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 748/1490] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:06.306012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 743/1491] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:06.307086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.312671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513cbc4-cd56-44b2-aeba-3f7e6e75641e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.325661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0647b-4a3f-4e98-87a5-87d564656429 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.437568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513cbc4-cd56-44b2-aeba-3f7e6e75641e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.447895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f840b-39db-4d8c-9b8f-4cf0c7b594bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.448587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f840b-39db-4d8c-9b8f-4cf0c7b594bb admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.448871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f840b-39db-4d8c-9b8f-4cf0c7b594bb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.449150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f840b-39db-4d8c-9b8f-4cf0c7b594bb admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.449884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f840b-39db-4d8c-9b8f-4cf0c7b594bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.452843 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f840b-39db-4d8c-9b8f-4cf0c7b594bb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.454676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e41cd-97a1-4d8b-85b6-dad50d0750bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.455488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e41cd-97a1-4d8b-85b6-dad50d0750bb admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.455809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e41cd-97a1-4d8b-85b6-dad50d0750bb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.456087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e41cd-97a1-4d8b-85b6-dad50d0750bb admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.458056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e41cd-97a1-4d8b-85b6-dad50d0750bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.460017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e41cd-97a1-4d8b-85b6-dad50d0750bb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.501598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 744/1492] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:06.506601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f840b-39db-4d8c-9b8f-4cf0c7b594bb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.522278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 749/1493] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:06.524336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f840b-39db-4d8c-9b8f-4cf0c7b594bb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.527266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e41cd-97a1-4d8b-85b6-dad50d0750bb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.654087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d48671-7742-4ab2-aa64-d72dc73f4c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.654778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48671-7742-4ab2-aa64-d72dc73f4c5b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.655060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48671-7742-4ab2-aa64-d72dc73f4c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.655335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48671-7742-4ab2-aa64-d72dc73f4c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.656089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d48671-7742-4ab2-aa64-d72dc73f4c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.657733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d48671-7742-4ab2-aa64-d72dc73f4c5b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.661567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e41cd-97a1-4d8b-85b6-dad50d0750bb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.672122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaeace-95ee-4118-8a47-3151f8b7a7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.672811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaeace-95ee-4118-8a47-3151f8b7a7ce admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.673096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaeace-95ee-4118-8a47-3151f8b7a7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.680363 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaeace-95ee-4118-8a47-3151f8b7a7ce admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.681200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaeace-95ee-4118-8a47-3151f8b7a7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.683187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaeace-95ee-4118-8a47-3151f8b7a7ce admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.688824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 745/1494] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:06 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:06.691045 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e39b-b07a-47b1-935e-ca0d67b42d1d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.696283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e39b-b07a-47b1-935e-ca0d67b42d1d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.696580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e39b-b07a-47b1-935e-ca0d67b42d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.721095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ad55e39b-b07a-47b1-935e-ca0d67b42d1d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.722475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ad55e39b-b07a-47b1-935e-ca0d67b42d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.731849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 746/1495] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.733896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5751b-29f6-4a3d-93af-0958a345161d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.734429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5751b-29f6-4a3d-93af-0958a345161d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.735040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5751b-29f6-4a3d-93af-0958a345161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.742670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 750/1496] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:06.744295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaeace-95ee-4118-8a47-3151f8b7a7ce admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.753540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaeace-95ee-4118-8a47-3151f8b7a7ce admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.758639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7b2d2-c3cc-466b-ac85-0c994503ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.759356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7b2d2-c3cc-466b-ac85-0c994503ba6e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.759647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7b2d2-c3cc-466b-ac85-0c994503ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.759951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7b2d2-c3cc-466b-ac85-0c994503ba6e admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.760730 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7b2d2-c3cc-466b-ac85-0c994503ba6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.762438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-cfc5751b-29f6-4a3d-93af-0958a345161d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.762596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7b2d2-c3cc-466b-ac85-0c994503ba6e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.764554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cfc5751b-29f6-4a3d-93af-0958a345161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.774302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 747/1498] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.774467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 751/1498] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:06.776261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf4b7-8d31-4f16-a015-93ff20ca2171 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.776825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf4b7-8d31-4f16-a015-93ff20ca2171 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.777340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf4b7-8d31-4f16-a015-93ff20ca2171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.779592 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b181b-daaa-4ef9-9e18-cf9332ed90ea None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.779912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b181b-daaa-4ef9-9e18-cf9332ed90ea None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.780195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b181b-daaa-4ef9-9e18-cf9332ed90ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.800077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-107b181b-daaa-4ef9-9e18-cf9332ed90ea None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.800588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-11fdf4b7-8d31-4f16-a015-93ff20ca2171 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.801391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-107b181b-daaa-4ef9-9e18-cf9332ed90ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.802243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-11fdf4b7-8d31-4f16-a015-93ff20ca2171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.810535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 752/1499] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.812584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 748/1500] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.813777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf4b7-8d31-4f16-a015-93ff20ca2171 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.821658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fd5e7-1cb0-4425-b38f-c478581cf58e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.822714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fd5e7-1cb0-4425-b38f-c478581cf58e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.823773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fd5e7-1cb0-4425-b38f-c478581cf58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.839095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf4b7-8d31-4f16-a015-93ff20ca2171 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.844697 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fb4fb-bd8b-4b4f-b2a9-6cea645ec63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.845378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb4fb-bd8b-4b4f-b2a9-6cea645ec63e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.845659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb4fb-bd8b-4b4f-b2a9-6cea645ec63e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.845936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb4fb-bd8b-4b4f-b2a9-6cea645ec63e admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.846667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fb4fb-bd8b-4b4f-b2a9-6cea645ec63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.848330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fb4fb-bd8b-4b4f-b2a9-6cea645ec63e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.853572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e49fd5e7-1cb0-4425-b38f-c478581cf58e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.854749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e49fd5e7-1cb0-4425-b38f-c478581cf58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.859472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 749/1501] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:06 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:06.860484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fb4fb-bd8b-4b4f-b2a9-6cea645ec63e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:06.863125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 753/1502] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.864396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7375fbb-81ca-46e4-b808-4af66fe45ada None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.864691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7375fbb-81ca-46e4-b808-4af66fe45ada None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.864968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7375fbb-81ca-46e4-b808-4af66fe45ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.871397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fb4fb-bd8b-4b4f-b2a9-6cea645ec63e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:06.876565 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9d155-2254-40a0-bdf5-d03595d9c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:06.877601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d155-2254-40a0-bdf5-d03595d9c318 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.877876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d155-2254-40a0-bdf5-d03595d9c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.878174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d155-2254-40a0-bdf5-d03595d9c318 admin admin] PATH_INFO: `/v3/projects/0e3e648ccf87421d9660e75180c946bd/users/17af4a654a6843e5a04c396917f60365/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.882770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d7375fbb-81ca-46e4-b808-4af66fe45ada None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.883959 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d7375fbb-81ca-46e4-b808-4af66fe45ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.891830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 754/1503] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.893062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c17b5-a875-4ea6-ac9e-fef17b95dcff None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.893352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c17b5-a875-4ea6-ac9e-fef17b95dcff None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.893630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c17b5-a875-4ea6-ac9e-fef17b95dcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.896660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9d155-2254-40a0-bdf5-d03595d9c318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3e648ccf87421d9660e75180c946bd, user_id=17af4a654a6843e5a04c396917f60365, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:06.899406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9d155-2254-40a0-bdf5-d03595d9c318 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:06.912003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-348c17b5-a875-4ea6-ac9e-fef17b95dcff None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.913114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-348c17b5-a875-4ea6-ac9e-fef17b95dcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.913584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 750/1504] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:06 2021] PUT /identity/v3/projects/0e3e648ccf87421d9660e75180c946bd/users/17af4a654a6843e5a04c396917f60365/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:06.914871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d003c-af4d-43ea-8008-4e8e756582e5 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.915168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d003c-af4d-43ea-8008-4e8e756582e5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.915448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d003c-af4d-43ea-8008-4e8e756582e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.932205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d35d003c-af4d-43ea-8008-4e8e756582e5 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.933380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d35d003c-af4d-43ea-8008-4e8e756582e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:06.974765 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 755/1505] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.976256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95085f-4364-43fc-a535-5360d27dd67b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.976544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95085f-4364-43fc-a535-5360d27dd67b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.976822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95085f-4364-43fc-a535-5360d27dd67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.991207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 751/1506] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:06.992539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1eaf4-8992-4ecb-8630-b31e7cb59f3d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:06.992828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1eaf4-8992-4ecb-8630-b31e7cb59f3d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:06.993102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1eaf4-8992-4ecb-8630-b31e7cb59f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:06.995673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8f95085f-4364-43fc-a535-5360d27dd67b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:06.997543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8f95085f-4364-43fc-a535-5360d27dd67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:07.005040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 756/1507] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:07.006931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95085f-4364-43fc-a535-5360d27dd67b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.013283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9ba1eaf4-8992-4ecb-8630-b31e7cb59f3d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:07.014448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9ba1eaf4-8992-4ecb-8630-b31e7cb59f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:07.015891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95085f-4364-43fc-a535-5360d27dd67b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.020213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35ca7-d656-4332-9829-c9c78de7ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.020860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35ca7-d656-4332-9829-c9c78de7ba17 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.021145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35ca7-d656-4332-9829-c9c78de7ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.021424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35ca7-d656-4332-9829-c9c78de7ba17 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.021713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 752/1508] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:07.028776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c35ca7-d656-4332-9829-c9c78de7ba17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.028887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1eaf4-8992-4ecb-8630-b31e7cb59f3d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.028993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c35ca7-d656-4332-9829-c9c78de7ba17 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.031437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1eaf4-8992-4ecb-8630-b31e7cb59f3d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.033929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 757/1509] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:07.034619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35ca7-d656-4332-9829-c9c78de7ba17 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.038482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8fe4-02aa-4746-89d8-40c72a376b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.039141 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8fe4-02aa-4746-89d8-40c72a376b2d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.039430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8fe4-02aa-4746-89d8-40c72a376b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.039736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8fe4-02aa-4746-89d8-40c72a376b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.040451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8fe4-02aa-4746-89d8-40c72a376b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:07.040763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8fe4-02aa-4746-89d8-40c72a376b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.042365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8fe4-02aa-4746-89d8-40c72a376b2d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.043375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35ca7-d656-4332-9829-c9c78de7ba17 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.047961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.048600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.048880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.049161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.049873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:07.050198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.051777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.054098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 753/1510] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:07.055210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f72a-91cf-4354-b39a-0079dc93e6b7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.055501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f72a-91cf-4354-b39a-0079dc93e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.055814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f72a-91cf-4354-b39a-0079dc93e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.066494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 758/1511] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:07.066494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.072592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2427f72a-91cf-4354-b39a-0079dc93e6b7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:07.073758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2427f72a-91cf-4354-b39a-0079dc93e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:07.076814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4272-01ae-468c-96a0-7fcba2cede8b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.081332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9842b-799a-4e42-99b8-ce48b5fb74c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.081934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 754/1512] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:07.085161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9842b-799a-4e42-99b8-ce48b5fb74c7 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.085161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9842b-799a-4e42-99b8-ce48b5fb74c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.085161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9842b-799a-4e42-99b8-ce48b5fb74c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.085387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f72a-91cf-4354-b39a-0079dc93e6b7 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.085932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9842b-799a-4e42-99b8-ce48b5fb74c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:07.085932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9842b-799a-4e42-99b8-ce48b5fb74c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.085932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9842b-799a-4e42-99b8-ce48b5fb74c7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.092289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f72a-91cf-4354-b39a-0079dc93e6b7 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.096979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a699bc3-772c-46f4-ab56-06c6b95be0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.097584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 759/1513] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:07.097714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699bc3-772c-46f4-ab56-06c6b95be0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.097921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699bc3-772c-46f4-ab56-06c6b95be0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.098198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699bc3-772c-46f4-ab56-06c6b95be0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.098925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a699bc3-772c-46f4-ab56-06c6b95be0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:07.099026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871471a5-2055-4588-ab25-d70e967cb0f2 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.099214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871471a5-2055-4588-ab25-d70e967cb0f2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.099306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a699bc3-772c-46f4-ab56-06c6b95be0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.099494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871471a5-2055-4588-ab25-d70e967cb0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.100870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a699bc3-772c-46f4-ab56-06c6b95be0d9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.113013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 755/1514] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:07.114278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6314d-79c6-49c1-a7a4-14b3540983d8 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.114571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6314d-79c6-49c1-a7a4-14b3540983d8 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.114847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6314d-79c6-49c1-a7a4-14b3540983d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.117743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-871471a5-2055-4588-ab25-d70e967cb0f2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:07.118908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-871471a5-2055-4588-ab25-d70e967cb0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:07.129083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 760/1515] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:07.130628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871471a5-2055-4588-ab25-d70e967cb0f2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.132726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0af6314d-79c6-49c1-a7a4-14b3540983d8 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:07.133716 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0af6314d-79c6-49c1-a7a4-14b3540983d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:07.139494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871471a5-2055-4588-ab25-d70e967cb0f2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.141579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 756/1516] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:07.142512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6314d-79c6-49c1-a7a4-14b3540983d8 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.146113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307a7a-188f-46af-8ffa-17dfb6f2f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.146972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307a7a-188f-46af-8ffa-17dfb6f2f0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.147248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307a7a-188f-46af-8ffa-17dfb6f2f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.147518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307a7a-188f-46af-8ffa-17dfb6f2f0f0 admin admin] PATH_INFO: `/v3/projects/da239fd2931445e6be6459a0225fbd85/users/f3ecf43d42c74783a82bf45afd8826e8/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.152278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6314d-79c6-49c1-a7a4-14b3540983d8 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.156715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.157405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.157624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.157897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.158569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.160567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.162113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307a7a-188f-46af-8ffa-17dfb6f2f0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da239fd2931445e6be6459a0225fbd85, user_id=f3ecf43d42c74783a82bf45afd8826e8, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.166097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307a7a-188f-46af-8ffa-17dfb6f2f0f0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.179743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 761/1517] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:07 2021] PUT /identity/v3/projects/da239fd2931445e6be6459a0225fbd85/users/f3ecf43d42c74783a82bf45afd8826e8/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:07.180564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307a7a-188f-46af-8ffa-17dfb6f2f0f0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.190410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 757/1518] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.190410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.191687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:07.241216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307a7a-188f-46af-8ffa-17dfb6f2f0f0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.244825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c8d9-cb65-48e1-bb2e-30662c436cfc admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.249014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f209d-15ee-4fd1-8c01-10e06fe96eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.249660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f209d-15ee-4fd1-8c01-10e06fe96eac service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.249944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f209d-15ee-4fd1-8c01-10e06fe96eac service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.250228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f209d-15ee-4fd1-8c01-10e06fe96eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.294916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08db7-0d22-452d-ba0d-938eef829b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.295579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08db7-0d22-452d-ba0d-938eef829b12 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.295898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08db7-0d22-452d-ba0d-938eef829b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.296187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08db7-0d22-452d-ba0d-938eef829b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.296869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c08db7-0d22-452d-ba0d-938eef829b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.298811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c08db7-0d22-452d-ba0d-938eef829b12 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.306570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f209d-15ee-4fd1-8c01-10e06fe96eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.308051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f209d-15ee-4fd1-8c01-10e06fe96eac service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.317990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 758/1519] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:07.318770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f209d-15ee-4fd1-8c01-10e06fe96eac service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.324091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 762/1520] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.325082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08db7-0d22-452d-ba0d-938eef829b12 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.330102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f209d-15ee-4fd1-8c01-10e06fe96eac service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.397222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46835b4-6fa3-4f5a-994b-d1623d536b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.397471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08db7-0d22-452d-ba0d-938eef829b12 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.397763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46835b4-6fa3-4f5a-994b-d1623d536b48 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.398030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46835b4-6fa3-4f5a-994b-d1623d536b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.398305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46835b4-6fa3-4f5a-994b-d1623d536b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.399012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46835b4-6fa3-4f5a-994b-d1623d536b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.401159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46835b4-6fa3-4f5a-994b-d1623d536b48 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.403293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4287-ad80-4617-b866-30f907677150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.404081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4287-ad80-4617-b866-30f907677150 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.404367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4287-ad80-4617-b866-30f907677150 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.404821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4287-ad80-4617-b866-30f907677150 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.405519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4287-ad80-4617-b866-30f907677150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.408052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4287-ad80-4617-b866-30f907677150 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.431792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 759/1521] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.431792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46835b4-6fa3-4f5a-994b-d1623d536b48 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.445170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 763/1522] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.445170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4287-ad80-4617-b866-30f907677150 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.497674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46835b4-6fa3-4f5a-994b-d1623d536b48 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.518597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4287-ad80-4617-b866-30f907677150 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.523016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789614b-f239-4259-8d00-45df677463ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.523678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789614b-f239-4259-8d00-45df677463ba admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.524026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789614b-f239-4259-8d00-45df677463ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.524314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789614b-f239-4259-8d00-45df677463ba admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.525095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789614b-f239-4259-8d00-45df677463ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:07.525655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789614b-f239-4259-8d00-45df677463ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.527479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789614b-f239-4259-8d00-45df677463ba admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.540696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 764/1523] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:07.557174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.557955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.558343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.559492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.561983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:07.562371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.564432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.569400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252367d-3ab6-4904-afbc-4498b296e321 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.569542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252367d-3ab6-4904-afbc-4498b296e321 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.569731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252367d-3ab6-4904-afbc-4498b296e321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.578074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 760/1524] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:07.579005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.593990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c37366-65a1-48c6-b598-a564849cdfe9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.597637 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6252367d-3ab6-4904-afbc-4498b296e321 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:07.598524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e0459-6520-47d6-a2f5-1cfa36700274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.599199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e0459-6520-47d6-a2f5-1cfa36700274 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.599484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e0459-6520-47d6-a2f5-1cfa36700274 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.599771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6252367d-3ab6-4904-afbc-4498b296e321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:07.599901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e0459-6520-47d6-a2f5-1cfa36700274 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.600456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e0459-6520-47d6-a2f5-1cfa36700274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.602368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e0459-6520-47d6-a2f5-1cfa36700274 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.608493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 765/1525] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:07.609492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252367d-3ab6-4904-afbc-4498b296e321 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.622338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252367d-3ab6-4904-afbc-4498b296e321 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.626840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec092d8-7391-48c1-a55a-90fc49bf7e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.627490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec092d8-7391-48c1-a55a-90fc49bf7e31 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.627800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec092d8-7391-48c1-a55a-90fc49bf7e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.628075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec092d8-7391-48c1-a55a-90fc49bf7e31 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.628758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec092d8-7391-48c1-a55a-90fc49bf7e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.629870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 761/1526] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.630719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e0459-6520-47d6-a2f5-1cfa36700274 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.631022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec092d8-7391-48c1-a55a-90fc49bf7e31 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.641617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e0459-6520-47d6-a2f5-1cfa36700274 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.646218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da250d-bc24-4460-b31f-bcf6857c4554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.646866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da250d-bc24-4460-b31f-bcf6857c4554 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.647125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da250d-bc24-4460-b31f-bcf6857c4554 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.647384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da250d-bc24-4460-b31f-bcf6857c4554 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.648099 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da250d-bc24-4460-b31f-bcf6857c4554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.650036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da250d-bc24-4460-b31f-bcf6857c4554 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.652937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 766/1527] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.656229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec092d8-7391-48c1-a55a-90fc49bf7e31 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.667406 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec092d8-7391-48c1-a55a-90fc49bf7e31 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.672583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676abc6a-146d-4abd-9417-b28daabda7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.673480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676abc6a-146d-4abd-9417-b28daabda7cd admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.673829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676abc6a-146d-4abd-9417-b28daabda7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.674551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676abc6a-146d-4abd-9417-b28daabda7cd admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.674916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676abc6a-146d-4abd-9417-b28daabda7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.678355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 762/1528] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/users => generated 302 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.678355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da250d-bc24-4460-b31f-bcf6857c4554 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.678684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676abc6a-146d-4abd-9417-b28daabda7cd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.686682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da250d-bc24-4460-b31f-bcf6857c4554 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.691913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8121c-5350-403c-8fba-0953e3d6ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.692613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8121c-5350-403c-8fba-0953e3d6ac3f admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.692957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8121c-5350-403c-8fba-0953e3d6ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.693277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8121c-5350-403c-8fba-0953e3d6ac3f admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.694133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8121c-5350-403c-8fba-0953e3d6ac3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.696280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8121c-5350-403c-8fba-0953e3d6ac3f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.706126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 767/1529] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.707243 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676abc6a-146d-4abd-9417-b28daabda7cd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.717066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676abc6a-146d-4abd-9417-b28daabda7cd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.721949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e0c2a-6004-40d9-88c4-1a26731a6425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.722688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0c2a-6004-40d9-88c4-1a26731a6425 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.723042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0c2a-6004-40d9-88c4-1a26731a6425 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.723387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0c2a-6004-40d9-88c4-1a26731a6425 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.724173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e0c2a-6004-40d9-88c4-1a26731a6425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.726159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e0c2a-6004-40d9-88c4-1a26731a6425 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.733889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 763/1530] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.735583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8121c-5350-403c-8fba-0953e3d6ac3f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.756746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 768/1531] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.757750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e0c2a-6004-40d9-88c4-1a26731a6425 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.799982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8121c-5350-403c-8fba-0953e3d6ac3f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.827047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e0c2a-6004-40d9-88c4-1a26731a6425 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.831566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732a54e-e190-45a9-b060-a5f3eb64ccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.832271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a54e-e190-45a9-b060-a5f3eb64ccc6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.832558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a54e-e190-45a9-b060-a5f3eb64ccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.832834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a54e-e190-45a9-b060-a5f3eb64ccc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.833619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732a54e-e190-45a9-b060-a5f3eb64ccc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.835221 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732a54e-e190-45a9-b060-a5f3eb64ccc6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.845619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 769/1532] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:07.848680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732a54e-e190-45a9-b060-a5f3eb64ccc6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.856308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95b69e-0684-45de-9e9e-243f0f6000ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.857235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b69e-0684-45de-9e9e-243f0f6000ee service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.857373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732a54e-e190-45a9-b060-a5f3eb64ccc6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.857595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b69e-0684-45de-9e9e-243f0f6000ee service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.857787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b69e-0684-45de-9e9e-243f0f6000ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.865026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17da6e-3e48-40a5-ad2c-866db96d84a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.865026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17da6e-3e48-40a5-ad2c-866db96d84a4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.865026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17da6e-3e48-40a5-ad2c-866db96d84a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.865386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17da6e-3e48-40a5-ad2c-866db96d84a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.866183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17da6e-3e48-40a5-ad2c-866db96d84a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.867930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17da6e-3e48-40a5-ad2c-866db96d84a4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.868750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95b69e-0684-45de-9e9e-243f0f6000ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.872932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95b69e-0684-45de-9e9e-243f0f6000ee service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.880214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 770/1533] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:07.881083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17da6e-3e48-40a5-ad2c-866db96d84a4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.890662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 764/1534] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:07.891516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95b69e-0684-45de-9e9e-243f0f6000ee service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.893686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17da6e-3e48-40a5-ad2c-866db96d84a4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.897891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3be8d-2f30-4e22-92ee-e0c60779d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.898746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3be8d-2f30-4e22-92ee-e0c60779d6eb admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.899530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3be8d-2f30-4e22-92ee-e0c60779d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.899871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3be8d-2f30-4e22-92ee-e0c60779d6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.900892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3be8d-2f30-4e22-92ee-e0c60779d6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.902503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95b69e-0684-45de-9e9e-243f0f6000ee service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.902672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3be8d-2f30-4e22-92ee-e0c60779d6eb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.909228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1365-6b2e-4716-a9b1-fea42aef5ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.909901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1365-6b2e-4716-a9b1-fea42aef5ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.910183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1365-6b2e-4716-a9b1-fea42aef5ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.910493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1365-6b2e-4716-a9b1-fea42aef5ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.911502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed1365-6b2e-4716-a9b1-fea42aef5ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.912822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed1365-6b2e-4716-a9b1-fea42aef5ae5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.914543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 771/1535] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:07.915506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3be8d-2f30-4e22-92ee-e0c60779d6eb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.925977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3be8d-2f30-4e22-92ee-e0c60779d6eb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.928456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 765/1536] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:07.931138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1365-6b2e-4716-a9b1-fea42aef5ae5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.931535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279599d-c857-4834-b78e-fc1c11d12cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.932362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279599d-c857-4834-b78e-fc1c11d12cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.932719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279599d-c857-4834-b78e-fc1c11d12cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.933072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279599d-c857-4834-b78e-fc1c11d12cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.934523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279599d-c857-4834-b78e-fc1c11d12cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.936967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279599d-c857-4834-b78e-fc1c11d12cd6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.942073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1365-6b2e-4716-a9b1-fea42aef5ae5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.947147 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b10e4-c28e-4949-8a00-12e3df3b470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.947864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b10e4-c28e-4949-8a00-12e3df3b470c admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.948148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b10e4-c28e-4949-8a00-12e3df3b470c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.948424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b10e4-c28e-4949-8a00-12e3df3b470c admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.949119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b10e4-c28e-4949-8a00-12e3df3b470c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.951953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b10e4-c28e-4949-8a00-12e3df3b470c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:07.961382 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 772/1537] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.965931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279599d-c857-4834-b78e-fc1c11d12cd6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.983922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 766/1538] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:07 2021] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:07.986182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b10e4-c28e-4949-8a00-12e3df3b470c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:07.989203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279599d-c857-4834-b78e-fc1c11d12cd6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:07.994365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3eb4-341f-45fb-8ac0-de55fbc384d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:07.995085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3eb4-341f-45fb-8ac0-de55fbc384d0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:07.995420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3eb4-341f-45fb-8ac0-de55fbc384d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:07.995728 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3eb4-341f-45fb-8ac0-de55fbc384d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:07.997276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e3eb4-341f-45fb-8ac0-de55fbc384d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:07.999034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e3eb4-341f-45fb-8ac0-de55fbc384d0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.002485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b10e4-c28e-4949-8a00-12e3df3b470c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.010001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c52fa-329c-4d78-b98f-6f3e9b38e512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.010695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c52fa-329c-4d78-b98f-6f3e9b38e512 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.010981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c52fa-329c-4d78-b98f-6f3e9b38e512 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.011934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c52fa-329c-4d78-b98f-6f3e9b38e512 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.012381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 773/1539] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:08.013146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c52fa-329c-4d78-b98f-6f3e9b38e512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.014835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c52fa-329c-4d78-b98f-6f3e9b38e512 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.016689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3eb4-341f-45fb-8ac0-de55fbc384d0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.028217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3eb4-341f-45fb-8ac0-de55fbc384d0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.031874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 767/1540] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:08.031874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c52fa-329c-4d78-b98f-6f3e9b38e512 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.040852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ac91-14e5-495b-bd64-9589408e6f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.041526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ac91-14e5-495b-bd64-9589408e6f39 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.041808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ac91-14e5-495b-bd64-9589408e6f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.042083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ac91-14e5-495b-bd64-9589408e6f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.042815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ac91-14e5-495b-bd64-9589408e6f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.045703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c52fa-329c-4d78-b98f-6f3e9b38e512 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.048474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ac91-14e5-495b-bd64-9589408e6f39 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.057146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2da20-fe10-4011-a930-2f4bcfb44ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.057952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2da20-fe10-4011-a930-2f4bcfb44ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.058333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2da20-fe10-4011-a930-2f4bcfb44ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.058624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2da20-fe10-4011-a930-2f4bcfb44ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.060233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2da20-fe10-4011-a930-2f4bcfb44ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.061725 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 774/1541] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:08 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:08.061955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2da20-fe10-4011-a930-2f4bcfb44ba8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.062633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ac91-14e5-495b-bd64-9589408e6f39 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.072141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ac91-14e5-495b-bd64-9589408e6f39 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.077279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9119b-e512-40d8-9f19-59e3120658bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.077530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 768/1542] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:08 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:08.078440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9119b-e512-40d8-9f19-59e3120658bd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.078562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2da20-fe10-4011-a930-2f4bcfb44ba8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.078915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9119b-e512-40d8-9f19-59e3120658bd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.079146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9119b-e512-40d8-9f19-59e3120658bd admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.080052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9119b-e512-40d8-9f19-59e3120658bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.081973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9119b-e512-40d8-9f19-59e3120658bd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.090689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2da20-fe10-4011-a930-2f4bcfb44ba8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.094207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 775/1543] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:08.095378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9119b-e512-40d8-9f19-59e3120658bd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.100101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d520f-cbdf-4927-83c3-04025985d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.101146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d520f-cbdf-4927-83c3-04025985d200 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.101435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d520f-cbdf-4927-83c3-04025985d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.102034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d520f-cbdf-4927-83c3-04025985d200 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.102441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d520f-cbdf-4927-83c3-04025985d200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.104089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d520f-cbdf-4927-83c3-04025985d200 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.106920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9119b-e512-40d8-9f19-59e3120658bd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.112134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a49a5-77d4-444a-b600-b92b49194e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.113174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a49a5-77d4-444a-b600-b92b49194e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.113530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a49a5-77d4-444a-b600-b92b49194e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.113880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a49a5-77d4-444a-b600-b92b49194e0c admin admin] PATH_INFO: `/v3/projects/bba3dccfb2384932a8c2db989c0570ad/users/b3c9b8e27067468ea19efc53a709c712/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.119130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 769/1544] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:08 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:08.119130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d520f-cbdf-4927-83c3-04025985d200 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.132563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d520f-cbdf-4927-83c3-04025985d200 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.133240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a49a5-77d4-444a-b600-b92b49194e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba3dccfb2384932a8c2db989c0570ad, user_id=b3c9b8e27067468ea19efc53a709c712, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.136494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a49a5-77d4-444a-b600-b92b49194e0c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.138257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48a39-42ac-48cd-a88c-499f4532521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.139294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48a39-42ac-48cd-a88c-499f4532521b admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.139754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48a39-42ac-48cd-a88c-499f4532521b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.140039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48a39-42ac-48cd-a88c-499f4532521b admin admin] PATH_INFO: `/v3/projects/ee20ad097bcc4c51a357aa0a803f59a8/users/fd82b48aabbb419cb891867d0b1a57e0/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.155470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 776/1545] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:08 2021] PUT /identity/v3/projects/bba3dccfb2384932a8c2db989c0570ad/users/b3c9b8e27067468ea19efc53a709c712/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:08.156581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a49a5-77d4-444a-b600-b92b49194e0c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.178153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f48a39-42ac-48cd-a88c-499f4532521b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee20ad097bcc4c51a357aa0a803f59a8, user_id=fd82b48aabbb419cb891867d0b1a57e0, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.181364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f48a39-42ac-48cd-a88c-499f4532521b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.198896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 770/1546] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:08 2021] PUT /identity/v3/projects/ee20ad097bcc4c51a357aa0a803f59a8/users/fd82b48aabbb419cb891867d0b1a57e0/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:08.200740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48a39-42ac-48cd-a88c-499f4532521b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.285497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a49a5-77d4-444a-b600-b92b49194e0c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.297240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c89e5b-33ca-466d-a412-ce09705773f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.299116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89e5b-33ca-466d-a412-ce09705773f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.300031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89e5b-33ca-466d-a412-ce09705773f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.300395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89e5b-33ca-466d-a412-ce09705773f4 admin admin] PATH_INFO: `/v3/projects/972cc04871274ca78d7f9ff27698c242/users/426b61809c68429b907dddac8ac0d6cd/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.315757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48a39-42ac-48cd-a88c-499f4532521b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.320476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c89e5b-33ca-466d-a412-ce09705773f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972cc04871274ca78d7f9ff27698c242, user_id=426b61809c68429b907dddac8ac0d6cd, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.329625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8da571-6edd-4156-b2dd-3e10ac0d6d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.332691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8da571-6edd-4156-b2dd-3e10ac0d6d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.332872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8da571-6edd-4156-b2dd-3e10ac0d6d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.333154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8da571-6edd-4156-b2dd-3e10ac0d6d2a admin admin] PATH_INFO: `/v3/projects/444e29bd8343439f98a99855dd7293ca/users/421bfb63b22d40959d35e4359d54383f/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.335348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c89e5b-33ca-466d-a412-ce09705773f4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.359370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8da571-6edd-4156-b2dd-3e10ac0d6d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=444e29bd8343439f98a99855dd7293ca, user_id=421bfb63b22d40959d35e4359d54383f, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.359875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 777/1547] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:08 2021] PUT /identity/v3/projects/972cc04871274ca78d7f9ff27698c242/users/426b61809c68429b907dddac8ac0d6cd/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:08.360852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c89e5b-33ca-466d-a412-ce09705773f4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.366331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8da571-6edd-4156-b2dd-3e10ac0d6d2a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.395753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 771/1548] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:08 2021] PUT /identity/v3/projects/444e29bd8343439f98a99855dd7293ca/users/421bfb63b22d40959d35e4359d54383f/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:08.395753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8da571-6edd-4156-b2dd-3e10ac0d6d2a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.467042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c89e5b-33ca-466d-a412-ce09705773f4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.469534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8da571-6edd-4156-b2dd-3e10ac0d6d2a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.473878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1efec-751a-4a45-b1a2-c5c9f7f9fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.475521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1efec-751a-4a45-b1a2-c5c9f7f9fb8f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.475851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1efec-751a-4a45-b1a2-c5c9f7f9fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.476136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1efec-751a-4a45-b1a2-c5c9f7f9fb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.477515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1efec-751a-4a45-b1a2-c5c9f7f9fb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.479654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1efec-751a-4a45-b1a2-c5c9f7f9fb8f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.483161 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c664c34-7a9b-4e0c-ad5a-8c7454879e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.483880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664c34-7a9b-4e0c-ad5a-8c7454879e29 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.484165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664c34-7a9b-4e0c-ad5a-8c7454879e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.484469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664c34-7a9b-4e0c-ad5a-8c7454879e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.485252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c664c34-7a9b-4e0c-ad5a-8c7454879e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.486857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c664c34-7a9b-4e0c-ad5a-8c7454879e29 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.498980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 772/1549] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:08 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:08.500520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789b54-d4e1-4249-8730-3ed3f20ab4b7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.500813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789b54-d4e1-4249-8730-3ed3f20ab4b7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.501126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789b54-d4e1-4249-8730-3ed3f20ab4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.501854 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 778/1550] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:08 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:08.503390 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5e78-705a-4adb-8950-a04b65a70368 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.503682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5e78-705a-4adb-8950-a04b65a70368 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.504141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5e78-705a-4adb-8950-a04b65a70368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.525940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c41a5e78-705a-4adb-8950-a04b65a70368 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:08.527433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c41a5e78-705a-4adb-8950-a04b65a70368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:08.536856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 779/1551] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:08.537275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1b789b54-d4e1-4249-8730-3ed3f20ab4b7 None None] MFA Rules not processed for user `b3c9b8e27067468ea19efc53a709c712`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:08.538145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664de537-2bba-42e0-b04b-9df7584e27c0 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.538428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664de537-2bba-42e0-b04b-9df7584e27c0 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.538699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664de537-2bba-42e0-b04b-9df7584e27c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.539430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1b789b54-d4e1-4249-8730-3ed3f20ab4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:08.576723 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-664de537-2bba-42e0-b04b-9df7584e27c0 None None] MFA Rules not processed for user `17af4a654a6843e5a04c396917f60365`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:08.577963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-664de537-2bba-42e0-b04b-9df7584e27c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:08.626001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 773/1552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:08 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:08.628246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea360-64c5-4a8d-bec7-e793125bba1d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.629075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea360-64c5-4a8d-bec7-e793125bba1d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.629461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea360-64c5-4a8d-bec7-e793125bba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.661797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 780/1553] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:08 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:08.663290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7d412-bc42-4eb6-9f07-1b26e1d7738b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.663583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7d412-bc42-4eb6-9f07-1b26e1d7738b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.663879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7d412-bc42-4eb6-9f07-1b26e1d7738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.677386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-dbeea360-64c5-4a8d-bec7-e793125bba1d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:08.678740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-dbeea360-64c5-4a8d-bec7-e793125bba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:08.688645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 774/1554] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:08.689536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeea360-64c5-4a8d-bec7-e793125bba1d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.700821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeea360-64c5-4a8d-bec7-e793125bba1d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.709820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-39f7d412-bc42-4eb6-9f07-1b26e1d7738b None None] MFA Rules not processed for user `421bfb63b22d40959d35e4359d54383f`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:08.710680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-39f7d412-bc42-4eb6-9f07-1b26e1d7738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:08.714444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb6b0-1330-422a-a688-714c986ec3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.716573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb6b0-1330-422a-a688-714c986ec3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.717154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb6b0-1330-422a-a688-714c986ec3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.718340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb6b0-1330-422a-a688-714c986ec3a9 admin admin] PATH_INFO: `/v3/projects/868b9f6490e04019a7af0b3477b833ce/users/57e46aaed3b64727a4eb3870b165dc8e/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.736723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bb6b0-1330-422a-a688-714c986ec3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868b9f6490e04019a7af0b3477b833ce, user_id=57e46aaed3b64727a4eb3870b165dc8e, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.739861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bb6b0-1330-422a-a688-714c986ec3a9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.763805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 775/1555] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:08 2021] PUT /identity/v3/projects/868b9f6490e04019a7af0b3477b833ce/users/57e46aaed3b64727a4eb3870b165dc8e/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:08.765101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb6b0-1330-422a-a688-714c986ec3a9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.787354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 781/1556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:08 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:08.787354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7d412-bc42-4eb6-9f07-1b26e1d7738b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.847470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb6b0-1330-422a-a688-714c986ec3a9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.852338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93718235-1103-416a-91e7-1e05a612a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.853709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718235-1103-416a-91e7-1e05a612a091 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.854001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718235-1103-416a-91e7-1e05a612a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.854278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718235-1103-416a-91e7-1e05a612a091 admin admin] PATH_INFO: `/v3/projects/e20265dc285042d5ab0d2e9237fe9fdf/users/faf7da464d4c44db918dd6c5076846e9/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.858832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7d412-bc42-4eb6-9f07-1b26e1d7738b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.875904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93718235-1103-416a-91e7-1e05a612a091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20265dc285042d5ab0d2e9237fe9fdf, user_id=faf7da464d4c44db918dd6c5076846e9, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.880051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93718235-1103-416a-91e7-1e05a612a091 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.896556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 776/1557] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:08 2021] PUT /identity/v3/projects/e20265dc285042d5ab0d2e9237fe9fdf/users/faf7da464d4c44db918dd6c5076846e9/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:08.898289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba3c91-bc48-4d6b-8a8a-e73f5d8b9141 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.898756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba3c91-bc48-4d6b-8a8a-e73f5d8b9141 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.899035 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba3c91-bc48-4d6b-8a8a-e73f5d8b9141 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.901120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 777/1558] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 28 03:37:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:37:08.902714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9aa75-1f67-43dc-91b5-7ae63bfe714b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.903007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9aa75-1f67-43dc-91b5-7ae63bfe714b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.903764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9aa75-1f67-43dc-91b5-7ae63bfe714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.921921 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc218c-70c3-4926-a50d-a0320a2aab83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:08.922581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc218c-70c3-4926-a50d-a0320a2aab83 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.922757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-06b9aa75-1f67-43dc-91b5-7ae63bfe714b None None] MFA Rules not processed for user `17af4a654a6843e5a04c396917f60365`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:08.923198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc218c-70c3-4926-a50d-a0320a2aab83 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.923490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc218c-70c3-4926-a50d-a0320a2aab83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:08.923933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-06b9aa75-1f67-43dc-91b5-7ae63bfe714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:08.932774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc218c-70c3-4926-a50d-a0320a2aab83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:08.935061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc218c-70c3-4926-a50d-a0320a2aab83 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:08.944430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 782/1559] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:08.945410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc218c-70c3-4926-a50d-a0320a2aab83 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:08.953135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc218c-70c3-4926-a50d-a0320a2aab83 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:08.992902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 778/1560] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:08 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:08.993885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a50f80-31b4-4061-9bc9-fffba409db52 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:08.994235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a50f80-31b4-4061-9bc9-fffba409db52 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:08.994517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a50f80-31b4-4061-9bc9-fffba409db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.015322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610a88e-cc35-4379-8294-d0dd7973c579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.016450 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a88e-cc35-4379-8294-d0dd7973c579 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.017107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a88e-cc35-4379-8294-d0dd7973c579 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.017466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a88e-cc35-4379-8294-d0dd7973c579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.022155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b5a50f80-31b4-4061-9bc9-fffba409db52 None None] MFA Rules not processed for user `57e46aaed3b64727a4eb3870b165dc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:09.023457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b5a50f80-31b4-4061-9bc9-fffba409db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:09.096566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610a88e-cc35-4379-8294-d0dd7973c579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.098678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610a88e-cc35-4379-8294-d0dd7973c579 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.107742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 779/1561] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:08 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:09.109326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1520-4c2a-4c85-9e7e-cc1da31dfe0b None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.109629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1520-4c2a-4c85-9e7e-cc1da31dfe0b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.109971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1520-4c2a-4c85-9e7e-cc1da31dfe0b None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.112115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 783/1563] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:09.112302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 780/1563] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 28 03:37:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:37:09.113394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a12de-ee6a-4a50-8342-81eea3c097dc None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.113669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a12de-ee6a-4a50-8342-81eea3c097dc None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.113787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8dd25-a836-4ed9-b555-3c9a384f57a8 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.113947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a12de-ee6a-4a50-8342-81eea3c097dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.114463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8dd25-a836-4ed9-b555-3c9a384f57a8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.114972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8dd25-a836-4ed9-b555-3c9a384f57a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.136844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c45a12de-ee6a-4a50-8342-81eea3c097dc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:09.138466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c45a12de-ee6a-4a50-8342-81eea3c097dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:09.148251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9ab8dd25-a836-4ed9-b555-3c9a384f57a8 None None] MFA Rules not processed for user `f3ecf43d42c74783a82bf45afd8826e8`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:09.149778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9ab8dd25-a836-4ed9-b555-3c9a384f57a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:09.154112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 781/1564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:09.156837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4496d-9613-493e-8d0d-4a44e89ebbe8 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.157184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4496d-9613-493e-8d0d-4a44e89ebbe8 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.157473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4496d-9613-493e-8d0d-4a44e89ebbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.180950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b3f4496d-9613-493e-8d0d-4a44e89ebbe8 None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:09.182370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b3f4496d-9613-493e-8d0d-4a44e89ebbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:09.223835 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 784/1565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:09.224643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8dd25-a836-4ed9-b555-3c9a384f57a8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.235362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8dd25-a836-4ed9-b555-3c9a384f57a8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.239855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392ab41-35a0-4671-b1a6-fc3c71d46e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.240707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ab41-35a0-4671-b1a6-fc3c71d46e65 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.240995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ab41-35a0-4671-b1a6-fc3c71d46e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.241350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ab41-35a0-4671-b1a6-fc3c71d46e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.242112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392ab41-35a0-4671-b1a6-fc3c71d46e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.244234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392ab41-35a0-4671-b1a6-fc3c71d46e65 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.260836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 782/1566] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:09.263635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcb596-e5f6-45d4-8a43-c0172b1836d5 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.264280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcb596-e5f6-45d4-8a43-c0172b1836d5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.264608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcb596-e5f6-45d4-8a43-c0172b1836d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.283453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b5bcb596-e5f6-45d4-8a43-c0172b1836d5 None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:09.283966 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 785/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:09.284924 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392ab41-35a0-4671-b1a6-fc3c71d46e65 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.285330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b5bcb596-e5f6-45d4-8a43-c0172b1836d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:09.345508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392ab41-35a0-4671-b1a6-fc3c71d46e65 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.351272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069f207-4dfe-4a05-ab1c-8b9829cb6b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.351971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069f207-4dfe-4a05-ab1c-8b9829cb6b3b service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.352260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069f207-4dfe-4a05-ab1c-8b9829cb6b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.352540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069f207-4dfe-4a05-ab1c-8b9829cb6b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.360636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 783/1568] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:09.362071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b3a7-2c33-4f7c-abbf-fae3bf39f04c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.362383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b3a7-2c33-4f7c-abbf-fae3bf39f04c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.362730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b3a7-2c33-4f7c-abbf-fae3bf39f04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.382393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2460b3a7-2c33-4f7c-abbf-fae3bf39f04c None None] MFA Rules not processed for user `f3ecf43d42c74783a82bf45afd8826e8`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:09.384321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2460b3a7-2c33-4f7c-abbf-fae3bf39f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:09.437632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069f207-4dfe-4a05-ab1c-8b9829cb6b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.439589 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069f207-4dfe-4a05-ab1c-8b9829cb6b3b service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.450838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 786/1569] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:09.451671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069f207-4dfe-4a05-ab1c-8b9829cb6b3b service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.462947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069f207-4dfe-4a05-ab1c-8b9829cb6b3b service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.463318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 784/1570] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:09.464966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b3a7-2c33-4f7c-abbf-fae3bf39f04c None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.470703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06611c57-14d8-49f7-95ae-117a2bc9a6c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.471436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06611c57-14d8-49f7-95ae-117a2bc9a6c5 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.472179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06611c57-14d8-49f7-95ae-117a2bc9a6c5 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.472179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06611c57-14d8-49f7-95ae-117a2bc9a6c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.483421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b3a7-2c33-4f7c-abbf-fae3bf39f04c None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.491747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32826-5d49-46e8-b84b-cfc05a365b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.492691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32826-5d49-46e8-b84b-cfc05a365b0e admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.493105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32826-5d49-46e8-b84b-cfc05a365b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.493616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32826-5d49-46e8-b84b-cfc05a365b0e admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.494440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb32826-5d49-46e8-b84b-cfc05a365b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.499448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb32826-5d49-46e8-b84b-cfc05a365b0e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.530863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 785/1571] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/users => generated 308 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:09.531831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32826-5d49-46e8-b84b-cfc05a365b0e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.548919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32826-5d49-46e8-b84b-cfc05a365b0e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.552582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06611c57-14d8-49f7-95ae-117a2bc9a6c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.554230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06611c57-14d8-49f7-95ae-117a2bc9a6c5 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.560957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39bf1e-e09a-4fbd-8cd5-631372f96a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.562080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39bf1e-e09a-4fbd-8cd5-631372f96a6d service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.562643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39bf1e-e09a-4fbd-8cd5-631372f96a6d service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.563336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39bf1e-e09a-4fbd-8cd5-631372f96a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.566168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 787/1572] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:09 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:09.567834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06611c57-14d8-49f7-95ae-117a2bc9a6c5 service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.581197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06611c57-14d8-49f7-95ae-117a2bc9a6c5 service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.588631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45b1e-5e14-4dfd-a77a-d925cc2b7893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.590932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45b1e-5e14-4dfd-a77a-d925cc2b7893 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.591391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45b1e-5e14-4dfd-a77a-d925cc2b7893 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.591735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45b1e-5e14-4dfd-a77a-d925cc2b7893 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.592543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae45b1e-5e14-4dfd-a77a-d925cc2b7893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.595081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae45b1e-5e14-4dfd-a77a-d925cc2b7893 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.611594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 788/1573] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:09.612521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45b1e-5e14-4dfd-a77a-d925cc2b7893 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.624067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45b1e-5e14-4dfd-a77a-d925cc2b7893 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.630695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f37a9f-4926-4106-b834-aeaf4c21a835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.632004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f37a9f-4926-4106-b834-aeaf4c21a835 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.632376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f37a9f-4926-4106-b834-aeaf4c21a835 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.632703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f37a9f-4926-4106-b834-aeaf4c21a835 admin admin] PATH_INFO: `/v3/projects/0a78b80ec6284240a639146e7b2a4941/users/7518d842f23b4317b712a8ed85a4ec36/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.634160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39bf1e-e09a-4fbd-8cd5-631372f96a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.636025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39bf1e-e09a-4fbd-8cd5-631372f96a6d service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.649578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 786/1574] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:09 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:09.654430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f37a9f-4926-4106-b834-aeaf4c21a835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78b80ec6284240a639146e7b2a4941, user_id=7518d842f23b4317b712a8ed85a4ec36, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.657131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f37a9f-4926-4106-b834-aeaf4c21a835 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.673381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 789/1575] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:09 2021] PUT /identity/v3/projects/0a78b80ec6284240a639146e7b2a4941/users/7518d842f23b4317b712a8ed85a4ec36/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:09.677601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39bf1e-e09a-4fbd-8cd5-631372f96a6d service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.690664 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39bf1e-e09a-4fbd-8cd5-631372f96a6d service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.768244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e471c-f08b-4728-8a1a-85895abbe970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.769446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e471c-f08b-4728-8a1a-85895abbe970 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.769966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e471c-f08b-4728-8a1a-85895abbe970 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.770559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e471c-f08b-4728-8a1a-85895abbe970 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.771775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e471c-f08b-4728-8a1a-85895abbe970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.774051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e471c-f08b-4728-8a1a-85895abbe970 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.790156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f37a9f-4926-4106-b834-aeaf4c21a835 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:09.801823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 787/1576] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:09.804849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f37a9f-4926-4106-b834-aeaf4c21a835 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:09.810966 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6523c-2d20-490a-88d2-499fb86f0e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:09.812324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6523c-2d20-490a-88d2-499fb86f0e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.812787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6523c-2d20-490a-88d2-499fb86f0e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.813256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6523c-2d20-490a-88d2-499fb86f0e29 admin admin] PATH_INFO: `/v3/projects/0a78b80ec6284240a639146e7b2a4941/users/7518d842f23b4317b712a8ed85a4ec36/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.816423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6523c-2d20-490a-88d2-499fb86f0e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78b80ec6284240a639146e7b2a4941, user_id=7518d842f23b4317b712a8ed85a4ec36, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:09.820380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6523c-2d20-490a-88d2-499fb86f0e29 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:09.836181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 790/1577] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:09 2021] PUT /identity/v3/projects/0a78b80ec6284240a639146e7b2a4941/users/7518d842f23b4317b712a8ed85a4ec36/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:09.846982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b306d4-a2d3-4c65-a3d6-508d02370e3f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.847537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b306d4-a2d3-4c65-a3d6-508d02370e3f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.848015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b306d4-a2d3-4c65-a3d6-508d02370e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.882882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-46b306d4-a2d3-4c65-a3d6-508d02370e3f None None] MFA Rules not processed for user `7518d842f23b4317b712a8ed85a4ec36`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:09.884861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-46b306d4-a2d3-4c65-a3d6-508d02370e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:09.897715 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c5ebb-2e18-4ea6-a7c2-9b97891812db None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.898390 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c5ebb-2e18-4ea6-a7c2-9b97891812db None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.898689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c5ebb-2e18-4ea6-a7c2-9b97891812db None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.900955 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 791/1578] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 28 03:37:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:37:09.906312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8364c-80aa-490d-86bd-926dcf87312d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:09.906969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8364c-80aa-490d-86bd-926dcf87312d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:09.906969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8364c-80aa-490d-86bd-926dcf87312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:09.936550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a0b8364c-80aa-490d-86bd-926dcf87312d None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:09.937942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a0b8364c-80aa-490d-86bd-926dcf87312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:09.988229 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 788/1579] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:09.988758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b306d4-a2d3-4c65-a3d6-508d02370e3f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:10.034625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 792/1580] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:37:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:10.036668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8364c-80aa-490d-86bd-926dcf87312d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:10.081904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b306d4-a2d3-4c65-a3d6-508d02370e3f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:10.089422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea76c1-fa01-4b7e-96c4-60481bd2dbeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:10.090683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea76c1-fa01-4b7e-96c4-60481bd2dbeb service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.090683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea76c1-fa01-4b7e-96c4-60481bd2dbeb service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.090973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea76c1-fa01-4b7e-96c4-60481bd2dbeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.122726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8364c-80aa-490d-86bd-926dcf87312d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:10.137859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a90d8-e666-4bb9-a48e-6fbb37c660f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:10.137859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a90d8-e666-4bb9-a48e-6fbb37c660f5 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.137859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a90d8-e666-4bb9-a48e-6fbb37c660f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.137859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a90d8-e666-4bb9-a48e-6fbb37c660f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.148316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a90d8-e666-4bb9-a48e-6fbb37c660f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:10.152079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a90d8-e666-4bb9-a48e-6fbb37c660f5 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:10.163126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea76c1-fa01-4b7e-96c4-60481bd2dbeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:10.165172 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea76c1-fa01-4b7e-96c4-60481bd2dbeb service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:10.166762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 793/1581] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:10 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:10.168013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a90d8-e666-4bb9-a48e-6fbb37c660f5 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:10.179373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 789/1582] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:09 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:10.191826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a90d8-e666-4bb9-a48e-6fbb37c660f5 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:10.205032 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c37f10-d8c5-4d76-9336-2f03edf46643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:10.206439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c37f10-d8c5-4d76-9336-2f03edf46643 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.207940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c37f10-d8c5-4d76-9336-2f03edf46643 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.210276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c37f10-d8c5-4d76-9336-2f03edf46643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.238618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c37f10-d8c5-4d76-9336-2f03edf46643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:10.240343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c37f10-d8c5-4d76-9336-2f03edf46643 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:10.288337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 794/1583] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:10.327573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8af5-bda8-494f-b94a-1abbccc03583 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.328084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8af5-bda8-494f-b94a-1abbccc03583 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.328370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8af5-bda8-494f-b94a-1abbccc03583 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.330484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 790/1584] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 28 03:37:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:37:10.341987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f78984-ede4-46ab-886f-dd35e42a0e3f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.342392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f78984-ede4-46ab-886f-dd35e42a0e3f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.342843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f78984-ede4-46ab-886f-dd35e42a0e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.373378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b0f78984-ede4-46ab-886f-dd35e42a0e3f None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:10.375122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b0f78984-ede4-46ab-886f-dd35e42a0e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:10.390457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 795/1585] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:37:10 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:10.408709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8af5-bda8-494f-b94a-1abbccc03583 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:10.413036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fe8b8af5-bda8-494f-b94a-1abbccc03583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:10.463122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f78984-ede4-46ab-886f-dd35e42a0e3f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:10.534069 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8af5-bda8-494f-b94a-1abbccc03583 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:10.545469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e143afb-8508-46e7-869d-4dbe81b24a2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:10.546501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143afb-8508-46e7-869d-4dbe81b24a2b service glance] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.547029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143afb-8508-46e7-869d-4dbe81b24a2b service glance] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.547410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143afb-8508-46e7-869d-4dbe81b24a2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.576482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e143afb-8508-46e7-869d-4dbe81b24a2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:10.579814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e143afb-8508-46e7-869d-4dbe81b24a2b service glance] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:10.602726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f78984-ede4-46ab-886f-dd35e42a0e3f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:10.606944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 791/1586] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:10.608577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb953e-ed67-4af4-b2f3-d3c105aad207 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.608965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb953e-ed67-4af4-b2f3-d3c105aad207 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.609248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb953e-ed67-4af4-b2f3-d3c105aad207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.622845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:10.626481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.627280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.627862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] PATH_INFO: `/v3/users/57e46aaed3b64727a4eb3870b165dc8e` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.630662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e46aaed3b64727a4eb3870b165dc8e)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:10.635062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:10.679544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-bbeb953e-ed67-4af4-b2f3-d3c105aad207 None None] MFA Rules not processed for user `426b61809c68429b907dddac8ac0d6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:10.680797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bbeb953e-ed67-4af4-b2f3-d3c105aad207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:10.754684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e46aaed3b64727a4eb3870b165dc8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:10.784210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e46aaed3b64727a4eb3870b165dc8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:10.786025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e46aaed3b64727a4eb3870b165dc8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:10.804682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e46aaed3b64727a4eb3870b165dc8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:10.805506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99143b3c-bab8-4ccc-9a3a-cd4c1a669c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e46aaed3b64727a4eb3870b165dc8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:10.830746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 796/1587] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:10 2021] DELETE /identity/v3/users/57e46aaed3b64727a4eb3870b165dc8e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:10.834854 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecf64-43c0-4bfd-9e1c-6d5327ff8eed None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.835262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecf64-43c0-4bfd-9e1c-6d5327ff8eed None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.835519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 792/1588] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:10 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:10.835823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecf64-43c0-4bfd-9e1c-6d5327ff8eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.838920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb953e-ed67-4af4-b2f3-d3c105aad207 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:10.848864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bbeb953e-ed67-4af4-b2f3-d3c105aad207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:10.872708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-967ecf64-43c0-4bfd-9e1c-6d5327ff8eed None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:10.874158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-967ecf64-43c0-4bfd-9e1c-6d5327ff8eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:10.875092 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb953e-ed67-4af4-b2f3-d3c105aad207 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:10.990413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f12748-571a-43cc-9da6-be30ea5e59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:10.991096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12748-571a-43cc-9da6-be30ea5e59fd admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:10.991377 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12748-571a-43cc-9da6-be30ea5e59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:10.991651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12748-571a-43cc-9da6-be30ea5e59fd admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:10.992386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f12748-571a-43cc-9da6-be30ea5e59fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:10.994308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f12748-571a-43cc-9da6-be30ea5e59fd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:10.997660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 797/1589] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:11.026236 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ecf64-43c0-4bfd-9e1c-6d5327ff8eed None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:11.028917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-967ecf64-43c0-4bfd-9e1c-6d5327ff8eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:11.055608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 793/1590] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:10 2021] POST /identity/v3/projects => generated 405 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:11.061159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f12748-571a-43cc-9da6-be30ea5e59fd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:11.184911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f12748-571a-43cc-9da6-be30ea5e59fd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:11.187587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ecf64-43c0-4bfd-9e1c-6d5327ff8eed None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:11.195818 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abbb2e-81b4-4fb4-9287-960ef2aa7116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:11.197676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbb2e-81b4-4fb4-9287-960ef2aa7116 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.197965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbb2e-81b4-4fb4-9287-960ef2aa7116 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.200404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbb2e-81b4-4fb4-9287-960ef2aa7116 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.203188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abbb2e-81b4-4fb4-9287-960ef2aa7116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:11.207644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abbb2e-81b4-4fb4-9287-960ef2aa7116 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:11.253410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 794/1591] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:11 2021] POST /identity/v3/users => generated 309 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:11.257266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abbb2e-81b4-4fb4-9287-960ef2aa7116 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:11.291123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abbb2e-81b4-4fb4-9287-960ef2aa7116 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:11.298786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5a386-892d-475d-b2b3-8137c628201f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:11.299655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a386-892d-475d-b2b3-8137c628201f service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.300291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a386-892d-475d-b2b3-8137c628201f service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.301191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a386-892d-475d-b2b3-8137c628201f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.303808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e5fc5-fac5-4678-8bbf-f5df456d5217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:11.305779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e5fc5-fac5-4678-8bbf-f5df456d5217 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.306073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e5fc5-fac5-4678-8bbf-f5df456d5217 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.307428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e5fc5-fac5-4678-8bbf-f5df456d5217 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.308591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e5fc5-fac5-4678-8bbf-f5df456d5217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:11.311369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e5fc5-fac5-4678-8bbf-f5df456d5217 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:11.325629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5a386-892d-475d-b2b3-8137c628201f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:11.329513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5a386-892d-475d-b2b3-8137c628201f service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:11.342949 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 795/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:11 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:11.346745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea269-8da2-4892-88ef-e426bc8746ff None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.347110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea269-8da2-4892-88ef-e426bc8746ff None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.347611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea269-8da2-4892-88ef-e426bc8746ff None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.350693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 796/1593] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 28 03:37:11 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:37:11.351660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ea269-8da2-4892-88ef-e426bc8746ff None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:11.353074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 798/1594] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:11.360071 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfb6c0-a054-4499-80b2-3fb53c1dd51c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.360586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfb6c0-a054-4499-80b2-3fb53c1dd51c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.361109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfb6c0-a054-4499-80b2-3fb53c1dd51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.395953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ea269-8da2-4892-88ef-e426bc8746ff None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:11.408117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459acb7e-c8ca-49f0-ab3f-e37aacceb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:11.411524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459acb7e-c8ca-49f0-ab3f-e37aacceb1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.412086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459acb7e-c8ca-49f0-ab3f-e37aacceb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.412387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459acb7e-c8ca-49f0-ab3f-e37aacceb1ee admin admin] PATH_INFO: `/v3/projects/e261a46fd82841c3856e8c170df3c750/users/0cde3a9df31e4282bfdf57cb0f42f033/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.448739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a3cfb6c0-a054-4499-80b2-3fb53c1dd51c None None] MFA Rules not processed for user `78279cb4fa504d18943cd8807b674cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:11.450808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a3cfb6c0-a054-4499-80b2-3fb53c1dd51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:11.457900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 799/1595] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:37:11 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:11.458094 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459acb7e-c8ca-49f0-ab3f-e37aacceb1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e261a46fd82841c3856e8c170df3c750, user_id=0cde3a9df31e4282bfdf57cb0f42f033, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:11.464794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459acb7e-c8ca-49f0-ab3f-e37aacceb1ee admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:11.501434 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 797/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:11 2021] PUT /identity/v3/projects/e261a46fd82841c3856e8c170df3c750/users/0cde3a9df31e4282bfdf57cb0f42f033/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:11.504874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfb6c0-a054-4499-80b2-3fb53c1dd51c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:11.506522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a3cfb6c0-a054-4499-80b2-3fb53c1dd51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:11.507109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459acb7e-c8ca-49f0-ab3f-e37aacceb1ee admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:11.629196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfb6c0-a054-4499-80b2-3fb53c1dd51c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:11.651612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459acb7e-c8ca-49f0-ab3f-e37aacceb1ee admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:11.661460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:11.662157 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.662443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.662765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.668600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:11.670537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:11.694762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 798/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:11 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:11.695642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:11.702684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:11.715157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:11.717954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.718596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.719351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.722587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:11.809398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc6f9-1d95-43ee-b037-ff54d20d5eb7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:11.819071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa019b3-a057-4781-83f7-3f08f8a5347e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:11.823608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa019b3-a057-4781-83f7-3f08f8a5347e service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.824373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa019b3-a057-4781-83f7-3f08f8a5347e service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.824373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa019b3-a057-4781-83f7-3f08f8a5347e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.830313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:11.834891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:11.846632 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa019b3-a057-4781-83f7-3f08f8a5347e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:11.852039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa019b3-a057-4781-83f7-3f08f8a5347e service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:11.867977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 800/1598] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:11 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:11.868941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:11.875945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 799/1599] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:11 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:11.897014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f4378-135b-467d-b1a9-5fff21f3fdca service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:11.909160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99ff13-40fb-4a91-a480-131bcde5d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:11.912166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99ff13-40fb-4a91-a480-131bcde5d938 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:11.912601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99ff13-40fb-4a91-a480-131bcde5d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:11.912961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99ff13-40fb-4a91-a480-131bcde5d938 admin admin] PATH_INFO: `/v3/projects/e261a46fd82841c3856e8c170df3c750/users/0cde3a9df31e4282bfdf57cb0f42f033/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:11.921643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99ff13-40fb-4a91-a480-131bcde5d938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e261a46fd82841c3856e8c170df3c750, user_id=0cde3a9df31e4282bfdf57cb0f42f033, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:11.925412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99ff13-40fb-4a91-a480-131bcde5d938 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:11.959359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 801/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:11 2021] PUT /identity/v3/projects/e261a46fd82841c3856e8c170df3c750/users/0cde3a9df31e4282bfdf57cb0f42f033/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:12.554293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa992db-6b9b-4d54-b58f-654e4981bd03 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:12.554824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa992db-6b9b-4d54-b58f-654e4981bd03 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:12.555025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa992db-6b9b-4d54-b58f-654e4981bd03 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:12.557211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 800/1601] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 28 03:37:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:37:12.565325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb3c2-37e7-431b-a7cd-28c7bc721dcd None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:12.565791 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb3c2-37e7-431b-a7cd-28c7bc721dcd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:12.566056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb3c2-37e7-431b-a7cd-28c7bc721dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:12.603757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-34ccb3c2-37e7-431b-a7cd-28c7bc721dcd None None] MFA Rules not processed for user `78279cb4fa504d18943cd8807b674cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:12.615779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-34ccb3c2-37e7-431b-a7cd-28c7bc721dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:12.769770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 802/1602] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:37:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:12.810770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa992db-6b9b-4d54-b58f-654e4981bd03 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:12.812753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9fa992db-6b9b-4d54-b58f-654e4981bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:12.856372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb3c2-37e7-431b-a7cd-28c7bc721dcd None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:12.869952 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb3c2-37e7-431b-a7cd-28c7bc721dcd None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:12.891138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:12.892472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:12.897244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:12.897548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:12.928853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:12.930147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:12.956211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 803/1603] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:12.993055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa992db-6b9b-4d54-b58f-654e4981bd03 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:12.999370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e5ad-c7b8-4494-b65b-ddffc1c512b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:13.000116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e5ad-c7b8-4494-b65b-ddffc1c512b8 service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:13.000374 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e5ad-c7b8-4494-b65b-ddffc1c512b8 service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:13.000656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e5ad-c7b8-4494-b65b-ddffc1c512b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:13.003588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1c12e5ad-c7b8-4494-b65b-ddffc1c512b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:13.017049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12e5ad-c7b8-4494-b65b-ddffc1c512b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:13.019181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12e5ad-c7b8-4494-b65b-ddffc1c512b8 service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:13.031431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 801/1604] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:12 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:13.267640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:13.269641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:13.395076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5ade-8eb5-45b6-9c98-7f297c0a5bd4 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:13.395486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5ade-8eb5-45b6-9c98-7f297c0a5bd4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:13.395904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac5ade-8eb5-45b6-9c98-7f297c0a5bd4 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:13.405220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 802/1605] 10.222.0.16 () {54 vars in 960 bytes} [Wed Jul 28 03:37:13 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:37:13.413017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617fdb2-55b8-4307-880a-15ead31eec81 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:13.413542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617fdb2-55b8-4307-880a-15ead31eec81 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:13.424484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617fdb2-55b8-4307-880a-15ead31eec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:13.459072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-a617fdb2-55b8-4307-880a-15ead31eec81 None None] MFA Rules not processed for user `d2b5335392b4400d94f1dfce0e010b74`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:13.462733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a617fdb2-55b8-4307-880a-15ead31eec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:13.492690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 803/1606] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jul 28 03:37:13 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:13.493740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617fdb2-55b8-4307-880a-15ead31eec81 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:13.518330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617fdb2-55b8-4307-880a-15ead31eec81 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:13.519768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aad32-c1bf-4ca8-a2bd-c28db0a53ef2 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:13.528697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:13.533653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:13.534213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:13.535004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] PATH_INFO: `/v3/projects/868b9f6490e04019a7af0b3477b833ce` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:13.537357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:13.538126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:13.538408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:13.539930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868b9f6490e04019a7af0b3477b833ce)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:13.540827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:13.541456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING py.warnings [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:13.541456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: warnings.warn(msg) Jul 28 03:37:13.541456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: Jul 28 03:37:13.545309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:13.562555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:13.600477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:13.602720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:13.646720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 804/1607] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:13 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:13.648610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868b9f6490e04019a7af0b3477b833ce', 'request_id': 'req-50fb980c-9c93-4148-9c07-64c6c5cd8512'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:13.666644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868b9f6490e04019a7af0b3477b833ce', 'request_id': 'req-50fb980c-9c93-4148-9c07-64c6c5cd8512'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:13.682721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868b9f6490e04019a7af0b3477b833ce', 'request_id': 'req-50fb980c-9c93-4148-9c07-64c6c5cd8512'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:13.728773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] The token cache is being invalidate because project 868b9f6490e04019a7af0b3477b833ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:13.753782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:13.758103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:13.776275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 804/1608] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:13 2021] DELETE /identity/v3/projects/868b9f6490e04019a7af0b3477b833ce => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:13.781366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:13.798193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e5262-0285-4b35-a5e3-9bcec5b7e839 service placement] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:13.876421 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:13.878681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:14.028923 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:14.029374 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:14.029706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:14.030012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] PATH_INFO: `/v3/users/7518d842f23b4317b712a8ed85a4ec36` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:14.034423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7518d842f23b4317b712a8ed85a4ec36)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:14.035504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: WARNING py.warnings [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:14.035504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: warnings.warn(msg) Jul 28 03:37:14.035504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: Jul 28 03:37:14.036787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:14.072687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb980c-9c93-4148-9c07-64c6c5cd8512 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:14.078188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:14.079395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:14.079902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:14.080353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] PATH_INFO: `/v3/users/421bfb63b22d40959d35e4359d54383f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:14.081797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421bfb63b22d40959d35e4359d54383f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:14.084047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:14.172421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7518d842f23b4317b712a8ed85a4ec36'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.190322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421bfb63b22d40959d35e4359d54383f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.203881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7518d842f23b4317b712a8ed85a4ec36'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.214050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421bfb63b22d40959d35e4359d54383f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.214940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421bfb63b22d40959d35e4359d54383f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.221850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7518d842f23b4317b712a8ed85a4ec36'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.222975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7518d842f23b4317b712a8ed85a4ec36'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.236203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3884e7f0-9862-459c-842d-afdd41784c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7518d842f23b4317b712a8ed85a4ec36'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.245484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421bfb63b22d40959d35e4359d54383f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.246718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421bfb63b22d40959d35e4359d54383f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.247993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 805/1609] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:13 2021] DELETE /identity/v3/users/7518d842f23b4317b712a8ed85a4ec36 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:14.271290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 805/1610] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:13 2021] DELETE /identity/v3/users/421bfb63b22d40959d35e4359d54383f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:14.277287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020491-c39c-4485-b2eb-a290bba7de5b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:14.278022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020491-c39c-4485-b2eb-a290bba7de5b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:14.278483 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020491-c39c-4485-b2eb-a290bba7de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:14.301285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c5020491-c39c-4485-b2eb-a290bba7de5b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:14.313212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c5020491-c39c-4485-b2eb-a290bba7de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:14.395735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 806/1611] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:14.422120 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:14.423782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:14.577298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37a4da-0d4a-43e1-b1c7-fe0db7e446e0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:14.588882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35b70b-3344-4af6-a72f-a4235069af06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:14.589487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b70b-3344-4af6-a72f-a4235069af06 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:14.589769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b70b-3344-4af6-a72f-a4235069af06 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:14.590087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b70b-3344-4af6-a72f-a4235069af06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:14.610541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35b70b-3344-4af6-a72f-a4235069af06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:14.613322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35b70b-3344-4af6-a72f-a4235069af06 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:14.628425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 806/1612] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:14.748814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5020491-c39c-4485-b2eb-a290bba7de5b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:14.753883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c5020491-c39c-4485-b2eb-a290bba7de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:14.791603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5020491-c39c-4485-b2eb-a290bba7de5b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:14.801910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:14.804766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:14.805053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:14.805339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] PATH_INFO: `/v3/users/b3c9b8e27067468ea19efc53a709c712` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:14.808881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c9b8e27067468ea19efc53a709c712)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:14.815202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:14.913499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c9b8e27067468ea19efc53a709c712'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.942208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c9b8e27067468ea19efc53a709c712'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.956644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c9b8e27067468ea19efc53a709c712'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.957492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c9b8e27067468ea19efc53a709c712'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:14.982303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c9b8e27067468ea19efc53a709c712'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:15.007722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 807/1613] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:14 2021] DELETE /identity/v3/users/b3c9b8e27067468ea19efc53a709c712 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:15.013283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f4dd-52f3-406b-8f9d-346ff0eabc70 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:15.013817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f4dd-52f3-406b-8f9d-346ff0eabc70 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:15.013817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f4dd-52f3-406b-8f9d-346ff0eabc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:15.064423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-bfd3f4dd-52f3-406b-8f9d-346ff0eabc70 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:15.065742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bfd3f4dd-52f3-406b-8f9d-346ff0eabc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:15.191524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 807/1614] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:15.214495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:15.216352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:15.348887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4f26-c5df-43cb-a3bd-c5d2d92e0a77 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:15.357575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:15.358295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:15.358575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:15.358907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:15.379813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:15.381411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:15.408646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 808/1615] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:15.880658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3f4dd-52f3-406b-8f9d-346ff0eabc70 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:15.882309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bfd3f4dd-52f3-406b-8f9d-346ff0eabc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:15.922646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3f4dd-52f3-406b-8f9d-346ff0eabc70 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:15.941163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:15.943684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:15.947507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:15.947936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] PATH_INFO: `/v3/projects/0a78b80ec6284240a639146e7b2a4941` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:15.952823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a78b80ec6284240a639146e7b2a4941)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:15.955732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:16.001236 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:16.002802 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:16.022933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f61713-5035-466c-961e-97d5206287f1 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:16.033575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:16.034918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.035381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.035840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] PATH_INFO: `/v3/projects/444e29bd8343439f98a99855dd7293ca` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.040263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444e29bd8343439f98a99855dd7293ca)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:16.044558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:16.105316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a78b80ec6284240a639146e7b2a4941', 'request_id': 'req-6c53a51c-cf30-4883-b4be-b29ba252e101'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.122088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a78b80ec6284240a639146e7b2a4941', 'request_id': 'req-6c53a51c-cf30-4883-b4be-b29ba252e101'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.144516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a78b80ec6284240a639146e7b2a4941', 'request_id': 'req-6c53a51c-cf30-4883-b4be-b29ba252e101'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.166876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] The token cache is being invalidate because project 0a78b80ec6284240a639146e7b2a4941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:16.167517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.170136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6c53a51c-cf30-4883-b4be-b29ba252e101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.174490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 808/1616] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:15 2021] DELETE /identity/v3/projects/0a78b80ec6284240a639146e7b2a4941 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:16.176324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117eed9-ef4e-4a12-80d3-f6d161f52c07 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.176826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117eed9-ef4e-4a12-80d3-f6d161f52c07 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.177133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444e29bd8343439f98a99855dd7293ca', 'request_id': 'req-de6bb8f8-e3a9-4402-b04f-ec2a30962751'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.177559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117eed9-ef4e-4a12-80d3-f6d161f52c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.186480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444e29bd8343439f98a99855dd7293ca', 'request_id': 'req-de6bb8f8-e3a9-4402-b04f-ec2a30962751'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.202666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444e29bd8343439f98a99855dd7293ca', 'request_id': 'req-de6bb8f8-e3a9-4402-b04f-ec2a30962751'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.225619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] The token cache is being invalidate because project 444e29bd8343439f98a99855dd7293ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:16.228788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.229811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-de6bb8f8-e3a9-4402-b04f-ec2a30962751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:16.239240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 809/1617] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:16 2021] DELETE /identity/v3/projects/444e29bd8343439f98a99855dd7293ca => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:16.239240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433e87-a501-4a8d-a6fd-3cdb92f427e1 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.239240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433e87-a501-4a8d-a6fd-3cdb92f427e1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.239240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433e87-a501-4a8d-a6fd-3cdb92f427e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.265962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6117eed9-ef4e-4a12-80d3-f6d161f52c07 None None] MFA Rules not processed for user `0cde3a9df31e4282bfdf57cb0f42f033`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:16.267425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6117eed9-ef4e-4a12-80d3-f6d161f52c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:16.292326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-67433e87-a501-4a8d-a6fd-3cdb92f427e1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:16.296807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-67433e87-a501-4a8d-a6fd-3cdb92f427e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:16.398034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 809/1618] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:16.399250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508ad9-6586-4db2-b605-7cb2d7965d7a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.399541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508ad9-6586-4db2-b605-7cb2d7965d7a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.399850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508ad9-6586-4db2-b605-7cb2d7965d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.413719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 810/1619] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:16.422683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444d1e-23ae-4193-8163-f0eed537a050 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.423130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444d1e-23ae-4193-8163-f0eed537a050 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.423812 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444d1e-23ae-4193-8163-f0eed537a050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.435274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d3508ad9-6586-4db2-b605-7cb2d7965d7a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:16.441800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d3508ad9-6586-4db2-b605-7cb2d7965d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:16.469203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 810/1620] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:16.474720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae431-53eb-4d60-b138-04133068448e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.475393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae431-53eb-4d60-b138-04133068448e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.475933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae431-53eb-4d60-b138-04133068448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.488807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d4444d1e-23ae-4193-8163-f0eed537a050 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:16.493769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d4444d1e-23ae-4193-8163-f0eed537a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:16.519543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fc1ae431-53eb-4d60-b138-04133068448e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:16.520902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fc1ae431-53eb-4d60-b138-04133068448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:16.527266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 811/1621] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:16.536146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444d1e-23ae-4193-8163-f0eed537a050 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:16.541829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 811/1622] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:16.546922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ae431-53eb-4d60-b138-04133068448e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:16.558243 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ae431-53eb-4d60-b138-04133068448e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:16.565383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444d1e-23ae-4193-8163-f0eed537a050 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:16.571537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:16.572251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.572532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.572806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.573551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:16.573857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:16.578424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:16.579110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.579388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.579677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.580501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:16.580810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:16.582470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:16.585512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:16.614948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 812/1623] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:16.616102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 812/1624] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:16.616521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:16.619940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:16.640444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5885c73-7683-46f5-80a8-fd3d17dd035c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:16.648571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f20ee5-b538-4405-92a6-91e966e03af2 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:16.653807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55c065-1ab6-43bb-a111-0413f82d8d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:16.654557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55c065-1ab6-43bb-a111-0413f82d8d47 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.654847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55c065-1ab6-43bb-a111-0413f82d8d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.655387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55c065-1ab6-43bb-a111-0413f82d8d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.656051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55c065-1ab6-43bb-a111-0413f82d8d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:16.666112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a46a0-c2f8-4354-8cb7-f3d53815821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:16.670125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a46a0-c2f8-4354-8cb7-f3d53815821c admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.672883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a46a0-c2f8-4354-8cb7-f3d53815821c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.673639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a46a0-c2f8-4354-8cb7-f3d53815821c admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.674384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a46a0-c2f8-4354-8cb7-f3d53815821c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:16.676341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a46a0-c2f8-4354-8cb7-f3d53815821c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:16.683171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55c065-1ab6-43bb-a111-0413f82d8d47 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:16.742190 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 813/1625] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:16.745040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e66a1-87e4-4668-bd8c-ccfee8830787 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.745353 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e66a1-87e4-4668-bd8c-ccfee8830787 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.745636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e66a1-87e4-4668-bd8c-ccfee8830787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.748706 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 813/1626] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:16.750191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a46a0-c2f8-4354-8cb7-f3d53815821c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:16.808529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3b3e66a1-87e4-4668-bd8c-ccfee8830787 None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:16.819737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3b3e66a1-87e4-4668-bd8c-ccfee8830787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:16.902938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a46a0-c2f8-4354-8cb7-f3d53815821c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:16.918697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61977-fc29-443b-87ca-d318ef606a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:16.919604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61977-fc29-443b-87ca-d318ef606a01 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.920057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61977-fc29-443b-87ca-d318ef606a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.920407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61977-fc29-443b-87ca-d318ef606a01 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.923798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b61977-fc29-443b-87ca-d318ef606a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:16.926275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b61977-fc29-443b-87ca-d318ef606a01 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:16.944237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 814/1627] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:16.945430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e66a1-87e4-4668-bd8c-ccfee8830787 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:16.969095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e66a1-87e4-4668-bd8c-ccfee8830787 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:16.974674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 814/1628] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:16.979031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61977-fc29-443b-87ca-d318ef606a01 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:16.983385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff91e2b-6c17-46ea-9eff-74051178fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:16.984576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91e2b-6c17-46ea-9eff-74051178fc74 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:16.985394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91e2b-6c17-46ea-9eff-74051178fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:16.988100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff91e2b-6c17-46ea-9eff-74051178fc74 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:16.989039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff91e2b-6c17-46ea-9eff-74051178fc74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:16.991456 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff91e2b-6c17-46ea-9eff-74051178fc74 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:17.024422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 815/1629] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:16 2021] POST /identity/v3/users => generated 290 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:17.028829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff91e2b-6c17-46ea-9eff-74051178fc74 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:17.031610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61977-fc29-443b-87ca-d318ef606a01 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:17.044050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff91e2b-6c17-46ea-9eff-74051178fc74 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:17.053205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1b03-4654-4c5e-a39d-e40abd2e36cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:17.054265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1b03-4654-4c5e-a39d-e40abd2e36cf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.056322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1b03-4654-4c5e-a39d-e40abd2e36cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.056861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1b03-4654-4c5e-a39d-e40abd2e36cf admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.057990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c1b03-4654-4c5e-a39d-e40abd2e36cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:17.060447 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c1b03-4654-4c5e-a39d-e40abd2e36cf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:17.061014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6cee-2f4a-484e-9cee-7e78a7d146ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:17.061792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6cee-2f4a-484e-9cee-7e78a7d146ea admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.062175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6cee-2f4a-484e-9cee-7e78a7d146ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.062522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6cee-2f4a-484e-9cee-7e78a7d146ea admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.063797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f6cee-2f4a-484e-9cee-7e78a7d146ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:17.066435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f6cee-2f4a-484e-9cee-7e78a7d146ea admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:17.076791 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 815/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:17.080360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1b03-4654-4c5e-a39d-e40abd2e36cf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:17.091656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1b03-4654-4c5e-a39d-e40abd2e36cf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:17.094520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 816/1631] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:17 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:17.098162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6cee-2f4a-484e-9cee-7e78a7d146ea admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:17.101165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a28c-b638-49f2-9a42-d11d8da21eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:17.102296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a28c-b638-49f2-9a42-d11d8da21eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.103309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a28c-b638-49f2-9a42-d11d8da21eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.104315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a28c-b638-49f2-9a42-d11d8da21eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.105327 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a28c-b638-49f2-9a42-d11d8da21eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:17.107997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a28c-b638-49f2-9a42-d11d8da21eb4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:17.119423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6cee-2f4a-484e-9cee-7e78a7d146ea admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:17.127046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 816/1632] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:17 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:17.132560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a28c-b638-49f2-9a42-d11d8da21eb4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:17.136377 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad161f-e7a8-40b4-a71a-8a651ab02ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:17.138945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad161f-e7a8-40b4-a71a-8a651ab02ffe admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.139233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad161f-e7a8-40b4-a71a-8a651ab02ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.139603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad161f-e7a8-40b4-a71a-8a651ab02ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.140448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad161f-e7a8-40b4-a71a-8a651ab02ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:17.147208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad161f-e7a8-40b4-a71a-8a651ab02ffe admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:17.153667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a28c-b638-49f2-9a42-d11d8da21eb4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:17.161008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:17.162473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.162939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.163612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] PATH_INFO: `/v3/projects/e7fe8d51b9f14c70b69491b1f4195b9b/users/f540c3d8595b4c899fbb8c3bafee9134/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.170960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 817/1633] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:17 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:17.174680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad161f-e7a8-40b4-a71a-8a651ab02ffe admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:17.184473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fe8d51b9f14c70b69491b1f4195b9b, user_id=f540c3d8595b4c899fbb8c3bafee9134, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:17.189046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:17.197689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad161f-e7a8-40b4-a71a-8a651ab02ffe admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:17.209446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181c719-67b1-44bc-aed6-7ef32e8709a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:17.211512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c719-67b1-44bc-aed6-7ef32e8709a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.211867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c719-67b1-44bc-aed6-7ef32e8709a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.213822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c719-67b1-44bc-aed6-7ef32e8709a6 admin admin] PATH_INFO: `/v3/projects/cfdca16d0bec4e48b9569e373b80dd7a/users/2ad0b3b5953841348c278af063e7cc57/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.225274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 817/1634] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:17 2021] PUT /identity/v3/projects/e7fe8d51b9f14c70b69491b1f4195b9b/users/f540c3d8595b4c899fbb8c3bafee9134/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:17.229318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:17.233843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:17.263826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181c719-67b1-44bc-aed6-7ef32e8709a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdca16d0bec4e48b9569e373b80dd7a, user_id=2ad0b3b5953841348c278af063e7cc57, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:17.271753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181c719-67b1-44bc-aed6-7ef32e8709a6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:17.303805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 818/1635] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:17 2021] PUT /identity/v3/projects/cfdca16d0bec4e48b9569e373b80dd7a/users/2ad0b3b5953841348c278af063e7cc57/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:17.303805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0d94e-6f60-4f21-a14d-9a373b874e5b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.303805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0d94e-6f60-4f21-a14d-9a373b874e5b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.303805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0d94e-6f60-4f21-a14d-9a373b874e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.352563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-29c0d94e-6f60-4f21-a14d-9a373b874e5b None None] MFA Rules not processed for user `f540c3d8595b4c899fbb8c3bafee9134`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:17.355047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-29c0d94e-6f60-4f21-a14d-9a373b874e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:17.412028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8a60d-017a-41e8-bc00-86aa5e7d884d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:17.572431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec13b6-ec7d-4a48-98ca-9ef66c22c4df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:17.573174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec13b6-ec7d-4a48-98ca-9ef66c22c4df service swift] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.574494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec13b6-ec7d-4a48-98ca-9ef66c22c4df service swift] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.574842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec13b6-ec7d-4a48-98ca-9ef66c22c4df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.611361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 819/1636] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:17 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:17.620283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269151f-4d2e-4af1-9b78-bef44fa9033d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:17.620574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269151f-4d2e-4af1-9b78-bef44fa9033d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:17.620853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269151f-4d2e-4af1-9b78-bef44fa9033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:17.709123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8269151f-4d2e-4af1-9b78-bef44fa9033d None None] MFA Rules not processed for user `2ad0b3b5953841348c278af063e7cc57`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:17.710894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8269151f-4d2e-4af1-9b78-bef44fa9033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:17.801436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec13b6-ec7d-4a48-98ca-9ef66c22c4df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:17.803772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec13b6-ec7d-4a48-98ca-9ef66c22c4df service swift] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:17.845300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 818/1637] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 03:37:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:17.856939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec13b6-ec7d-4a48-98ca-9ef66c22c4df service swift] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:17.857114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 820/1638] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:17 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:17.870751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269151f-4d2e-4af1-9b78-bef44fa9033d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:18.009713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec13b6-ec7d-4a48-98ca-9ef66c22c4df service swift] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:18.019166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626abe0-3c8c-425f-bedb-f9ab228a14e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:18.019886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626abe0-3c8c-425f-bedb-f9ab228a14e9 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:18.020170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626abe0-3c8c-425f-bedb-f9ab228a14e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:18.020490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626abe0-3c8c-425f-bedb-f9ab228a14e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:18.021283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626abe0-3c8c-425f-bedb-f9ab228a14e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:18.023316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626abe0-3c8c-425f-bedb-f9ab228a14e9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:18.099150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 819/1639] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:17 2021] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:18.104780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626abe0-3c8c-425f-bedb-f9ab228a14e9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:18.126539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269151f-4d2e-4af1-9b78-bef44fa9033d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:18.268304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626abe0-3c8c-425f-bedb-f9ab228a14e9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:18.283388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eace5e7-044b-4960-9602-7d04b69f12f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:18.284419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eace5e7-044b-4960-9602-7d04b69f12f6 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:18.285216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eace5e7-044b-4960-9602-7d04b69f12f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:18.285657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eace5e7-044b-4960-9602-7d04b69f12f6 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:18.286511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eace5e7-044b-4960-9602-7d04b69f12f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:18.292579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eace5e7-044b-4960-9602-7d04b69f12f6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:18.336498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0df55-650b-44a1-8836-19d1fec8115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:18.337197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0df55-650b-44a1-8836-19d1fec8115c admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:18.337480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0df55-650b-44a1-8836-19d1fec8115c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:18.337755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0df55-650b-44a1-8836-19d1fec8115c admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:18.338468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0df55-650b-44a1-8836-19d1fec8115c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:18.340495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0df55-650b-44a1-8836-19d1fec8115c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:18.345786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 820/1640] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:18 2021] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:18.347923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eace5e7-044b-4960-9602-7d04b69f12f6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:18.374758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eace5e7-044b-4960-9602-7d04b69f12f6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:18.390603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d35a6-934e-4dfd-a336-103c46dc1374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:18.391584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d35a6-934e-4dfd-a336-103c46dc1374 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:18.392046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d35a6-934e-4dfd-a336-103c46dc1374 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:18.392477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d35a6-934e-4dfd-a336-103c46dc1374 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:18.393367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d35a6-934e-4dfd-a336-103c46dc1374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:18.397744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d35a6-934e-4dfd-a336-103c46dc1374 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:18.437733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 821/1641] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:18 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:18.438964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d35a6-934e-4dfd-a336-103c46dc1374 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:18.454359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 821/1642] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:17 2021] POST /identity/v3/projects => generated 379 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:18.459408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0df55-650b-44a1-8836-19d1fec8115c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:18.471209 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d35a6-934e-4dfd-a336-103c46dc1374 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:18.552234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0df55-650b-44a1-8836-19d1fec8115c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:18.558784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:18.559479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:18.559786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:18.560062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:18.560757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:18.562714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:18.601181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 822/1643] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:18 2021] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:18.601181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:18.602904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:18.623749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda33a5-3d00-4291-9339-eb0b749daa55 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:18.637663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:18.639971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:18.640314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:18.640596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] PATH_INFO: `/v3/projects/bba3dccfb2384932a8c2db989c0570ad` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:18.644957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba3dccfb2384932a8c2db989c0570ad)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:18.655060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:18.713183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea037c37-c6fd-4821-80f5-ac528a2c343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:18.718174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea037c37-c6fd-4821-80f5-ac528a2c343e admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:18.718573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea037c37-c6fd-4821-80f5-ac528a2c343e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:18.719027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea037c37-c6fd-4821-80f5-ac528a2c343e admin admin] PATH_INFO: `/v3/projects/7f9388f36d0243f7928a46570ae894da/users/5b0b03146bb84d36bba39be334f0e114/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:18.759857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba3dccfb2384932a8c2db989c0570ad', 'request_id': 'req-35e4c757-6fd3-4944-8d6e-23a91b6196d2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:18.774043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba3dccfb2384932a8c2db989c0570ad', 'request_id': 'req-35e4c757-6fd3-4944-8d6e-23a91b6196d2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:18.787046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea037c37-c6fd-4821-80f5-ac528a2c343e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9388f36d0243f7928a46570ae894da, user_id=5b0b03146bb84d36bba39be334f0e114, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:18.797009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba3dccfb2384932a8c2db989c0570ad', 'request_id': 'req-35e4c757-6fd3-4944-8d6e-23a91b6196d2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:18.806325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea037c37-c6fd-4821-80f5-ac528a2c343e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:18.822240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] The token cache is being invalidate because project bba3dccfb2384932a8c2db989c0570ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:18.822928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:18.824015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:18.826836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 823/1644] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:18 2021] DELETE /identity/v3/projects/bba3dccfb2384932a8c2db989c0570ad => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:18.828029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:18.832918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:18.852148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 822/1645] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:18 2021] PUT /identity/v3/projects/7f9388f36d0243f7928a46570ae894da/users/5b0b03146bb84d36bba39be334f0e114/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:18.858812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db152f-58a3-49ed-b15f-de8f4367b5f5 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:18.859159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db152f-58a3-49ed-b15f-de8f4367b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:18.860368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db152f-58a3-49ed-b15f-de8f4367b5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:18.929937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d7db152f-58a3-49ed-b15f-de8f4367b5f5 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:18.931348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d7db152f-58a3-49ed-b15f-de8f4367b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:19.072400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c757-6fd3-4944-8d6e-23a91b6196d2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:19.134148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 823/1646] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:19.134148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db152f-58a3-49ed-b15f-de8f4367b5f5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:19.134148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d7db152f-58a3-49ed-b15f-de8f4367b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:19.169077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db152f-58a3-49ed-b15f-de8f4367b5f5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:19.190432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596389b5-542d-472e-8884-6919402ed195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:19.192571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596389b5-542d-472e-8884-6919402ed195 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:19.193011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596389b5-542d-472e-8884-6919402ed195 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:19.193294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596389b5-542d-472e-8884-6919402ed195 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:19.195363 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596389b5-542d-472e-8884-6919402ed195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:19.197058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596389b5-542d-472e-8884-6919402ed195 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:19.222332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 824/1647] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:19 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:19.222332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a40c-3bbf-451a-8d47-72f8559ef59a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:19.222332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a40c-3bbf-451a-8d47-72f8559ef59a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:19.222332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a40c-3bbf-451a-8d47-72f8559ef59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:19.243328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c235-4464-49ae-a7a8-4884ef836d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:19.244564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c235-4464-49ae-a7a8-4884ef836d4b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:19.244948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c235-4464-49ae-a7a8-4884ef836d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:19.245325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c235-4464-49ae-a7a8-4884ef836d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:19.246785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8c235-4464-49ae-a7a8-4884ef836d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:19.250640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8c235-4464-49ae-a7a8-4884ef836d4b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:19.268165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fc02a40c-3bbf-451a-8d47-72f8559ef59a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:19.269401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fc02a40c-3bbf-451a-8d47-72f8559ef59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:19.290069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 825/1648] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:19.290069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02a40c-3bbf-451a-8d47-72f8559ef59a None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:19.299534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 824/1649] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:18 2021] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:19.300725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c235-4464-49ae-a7a8-4884ef836d4b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:19.305147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02a40c-3bbf-451a-8d47-72f8559ef59a None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:19.328894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695be934-ee53-4cd7-a1a5-9ae4475046ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:19.331442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be934-ee53-4cd7-a1a5-9ae4475046ff admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:19.331803 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c235-4464-49ae-a7a8-4884ef836d4b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:19.332274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be934-ee53-4cd7-a1a5-9ae4475046ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:19.333224 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be934-ee53-4cd7-a1a5-9ae4475046ff admin admin] PATH_INFO: `/v3/projects/7f9388f36d0243f7928a46570ae894da/users/5b0b03146bb84d36bba39be334f0e114/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:19.339293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695be934-ee53-4cd7-a1a5-9ae4475046ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9388f36d0243f7928a46570ae894da, user_id=5b0b03146bb84d36bba39be334f0e114, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:19.352229 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:19.353049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:19.353447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:19.353875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:19.355333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:19.356163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695be934-ee53-4cd7-a1a5-9ae4475046ff admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:19.358039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:19.359834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:19.393667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 826/1650] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:19 2021] PUT /identity/v3/projects/7f9388f36d0243f7928a46570ae894da/users/5b0b03146bb84d36bba39be334f0e114/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:19.398192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695be934-ee53-4cd7-a1a5-9ae4475046ff admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:19.433191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 825/1651] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:19.441016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:19.488306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955b8ca-d374-40a0-b732-84250442fa54 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:19.687992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695be934-ee53-4cd7-a1a5-9ae4475046ff admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:19.698835 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaa6cd-add8-4236-9ca7-d2e26de4fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:19.699489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaa6cd-add8-4236-9ca7-d2e26de4fee5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:19.699803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaa6cd-add8-4236-9ca7-d2e26de4fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:19.700469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaa6cd-add8-4236-9ca7-d2e26de4fee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:19.700826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaa6cd-add8-4236-9ca7-d2e26de4fee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:19.705582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaa6cd-add8-4236-9ca7-d2e26de4fee5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:19.724879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37b66e-2d9c-4183-a3ff-10a96970b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:19.732901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37b66e-2d9c-4183-a3ff-10a96970b9aa admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:19.733284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37b66e-2d9c-4183-a3ff-10a96970b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:19.733571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37b66e-2d9c-4183-a3ff-10a96970b9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:19.736402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37b66e-2d9c-4183-a3ff-10a96970b9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:19.738186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37b66e-2d9c-4183-a3ff-10a96970b9aa admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:19.744798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 827/1652] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:19 2021] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:19.747920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734637e6-a507-461c-8d07-121b779beb5d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:19.748220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734637e6-a507-461c-8d07-121b779beb5d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:19.748501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734637e6-a507-461c-8d07-121b779beb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:19.815044 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 826/1653] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:19 2021] POST /identity/v3/projects => generated 373 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:19.815935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37b66e-2d9c-4183-a3ff-10a96970b9aa admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:19.852393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-734637e6-a507-461c-8d07-121b779beb5d None None] MFA Rules not processed for user `5b0b03146bb84d36bba39be334f0e114`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:19.857160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-734637e6-a507-461c-8d07-121b779beb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:20.040591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 828/1654] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:19 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:20.042109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734637e6-a507-461c-8d07-121b779beb5d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:20.044829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37b66e-2d9c-4183-a3ff-10a96970b9aa admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:20.067479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfedeb-0978-48b3-9365-baf21d50d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:20.068481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfedeb-0978-48b3-9365-baf21d50d393 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:20.068765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfedeb-0978-48b3-9365-baf21d50d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:20.069052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfedeb-0978-48b3-9365-baf21d50d393 admin admin] PATH_INFO: `/v3/projects/60a8bb3f862d4060912f97f555c82f89/users/493e32ab548942b199fe343475539611/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:20.076391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734637e6-a507-461c-8d07-121b779beb5d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:20.093631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:20.094948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:20.095472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:20.095990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:20.096903 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:20.099276 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:20.130174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfedeb-0978-48b3-9365-baf21d50d393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a8bb3f862d4060912f97f555c82f89, user_id=493e32ab548942b199fe343475539611, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:20.134408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfedeb-0978-48b3-9365-baf21d50d393 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:20.159418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 829/1655] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:20 2021] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:20.160851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:20.163113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:20.169344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 827/1656] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:19 2021] PUT /identity/v3/projects/60a8bb3f862d4060912f97f555c82f89/users/493e32ab548942b199fe343475539611/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:20.170953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfedeb-0978-48b3-9365-baf21d50d393 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:20.313912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ff72-159e-44a6-85aa-3dc65e784cfe admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:20.387642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfedeb-0978-48b3-9365-baf21d50d393 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:20.404678 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70abac-7d61-4225-9331-ada37e8e623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:20.405386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70abac-7d61-4225-9331-ada37e8e623c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:20.405724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70abac-7d61-4225-9331-ada37e8e623c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:20.405958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70abac-7d61-4225-9331-ada37e8e623c admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:20.406688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70abac-7d61-4225-9331-ada37e8e623c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:20.408933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70abac-7d61-4225-9331-ada37e8e623c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:20.432478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 828/1657] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:20.434680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1cd9d-ce9d-4fb6-8c8b-30dc9e02f1ea None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:20.435008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1cd9d-ce9d-4fb6-8c8b-30dc9e02f1ea None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:20.435290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1cd9d-ce9d-4fb6-8c8b-30dc9e02f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:20.439439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a56c82-519b-45dd-a1cb-c14abb71c07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:20.440864 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a56c82-519b-45dd-a1cb-c14abb71c07c service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:20.441613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a56c82-519b-45dd-a1cb-c14abb71c07c service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:20.442076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a56c82-519b-45dd-a1cb-c14abb71c07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:20.510302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f4d1cd9d-ce9d-4fb6-8c8b-30dc9e02f1ea None None] MFA Rules not processed for user `493e32ab548942b199fe343475539611`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:20.511588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f4d1cd9d-ce9d-4fb6-8c8b-30dc9e02f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:20.616881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a56c82-519b-45dd-a1cb-c14abb71c07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:20.622944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a56c82-519b-45dd-a1cb-c14abb71c07c service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:20.670005 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 830/1658] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:20 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:20.671337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a56c82-519b-45dd-a1cb-c14abb71c07c service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:20.676206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 829/1659] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:20 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:20.681563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1cd9d-ce9d-4fb6-8c8b-30dc9e02f1ea None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:20.719014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a56c82-519b-45dd-a1cb-c14abb71c07c service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:20.725724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1cd9d-ce9d-4fb6-8c8b-30dc9e02f1ea None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:20.732604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eaa9e-9f31-484f-a8e3-091091841a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:20.736976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eaa9e-9f31-484f-a8e3-091091841a44 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:20.737301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eaa9e-9f31-484f-a8e3-091091841a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:20.737602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eaa9e-9f31-484f-a8e3-091091841a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:20.739112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910eaa9e-9f31-484f-a8e3-091091841a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:20.742219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910eaa9e-9f31-484f-a8e3-091091841a44 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:20.748834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea586-69cb-4896-a51c-10ad2830e048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:20.749519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea586-69cb-4896-a51c-10ad2830e048 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:20.749807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea586-69cb-4896-a51c-10ad2830e048 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:20.759428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea586-69cb-4896-a51c-10ad2830e048 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:20.760273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ea586-69cb-4896-a51c-10ad2830e048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:20.763626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ea586-69cb-4896-a51c-10ad2830e048 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:20.772927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 831/1660] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:20.777184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eaa9e-9f31-484f-a8e3-091091841a44 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:20.854830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eaa9e-9f31-484f-a8e3-091091841a44 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:20.863371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1539b7-40ef-4ed6-a615-c3d138bea4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:20.864534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1539b7-40ef-4ed6-a615-c3d138bea4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:20.864893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1539b7-40ef-4ed6-a615-c3d138bea4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:20.865257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1539b7-40ef-4ed6-a615-c3d138bea4f9 admin admin] PATH_INFO: `/v3/projects/6fa3f6372cde471dbf0a48befa921c43/users/7825eab50bc048d0a8e1bcd5f751adab/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:20.901183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1539b7-40ef-4ed6-a615-c3d138bea4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa3f6372cde471dbf0a48befa921c43, user_id=7825eab50bc048d0a8e1bcd5f751adab, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:20.916844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1539b7-40ef-4ed6-a615-c3d138bea4f9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:20.922183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 830/1661] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:20 2021] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:20.923044 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea586-69cb-4896-a51c-10ad2830e048 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:20.962479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 832/1662] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:20 2021] PUT /identity/v3/projects/6fa3f6372cde471dbf0a48befa921c43/users/7825eab50bc048d0a8e1bcd5f751adab/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:20.969986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1539b7-40ef-4ed6-a615-c3d138bea4f9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:21.070111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea586-69cb-4896-a51c-10ad2830e048 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:21.179395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1539b7-40ef-4ed6-a615-c3d138bea4f9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:21.191102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce2351-b7fa-44da-9057-da3478aafa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:21.192204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2351-b7fa-44da-9057-da3478aafa55 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:21.192493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2351-b7fa-44da-9057-da3478aafa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:21.192772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2351-b7fa-44da-9057-da3478aafa55 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:21.194352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce2351-b7fa-44da-9057-da3478aafa55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:21.199607 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce2351-b7fa-44da-9057-da3478aafa55 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:21.224824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:21.229691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:21.231158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:21.232198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] PATH_INFO: `/v3/users/f540c3d8595b4c899fbb8c3bafee9134` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:21.233921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f540c3d8595b4c899fbb8c3bafee9134)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:21.259325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:21.305761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 833/1663] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:20 2021] POST /identity/v3/users => generated 296 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:21.311772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee2abf-430d-4efc-b8f4-ea4a0b1f32a4 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:21.312759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee2abf-430d-4efc-b8f4-ea4a0b1f32a4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:21.313281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee2abf-430d-4efc-b8f4-ea4a0b1f32a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:21.379542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8eee2abf-430d-4efc-b8f4-ea4a0b1f32a4 None None] MFA Rules not processed for user `7825eab50bc048d0a8e1bcd5f751adab`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:21.381280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8eee2abf-430d-4efc-b8f4-ea4a0b1f32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:21.458105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f540c3d8595b4c899fbb8c3bafee9134'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:21.495654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f540c3d8595b4c899fbb8c3bafee9134'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:21.543453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f540c3d8595b4c899fbb8c3bafee9134'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:21.547503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f540c3d8595b4c899fbb8c3bafee9134'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:21.570733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 834/1664] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:21 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:21.571699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee2abf-430d-4efc-b8f4-ea4a0b1f32a4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:21.576980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aecadb8-a2cd-4766-ab2d-0642bb86942e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f540c3d8595b4c899fbb8c3bafee9134'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:21.589623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 831/1665] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:20 2021] DELETE /identity/v3/users/f540c3d8595b4c899fbb8c3bafee9134 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:21.597638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2277-1384-494f-aa1f-635b403b3da7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:21.598600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2277-1384-494f-aa1f-635b403b3da7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:21.599386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2277-1384-494f-aa1f-635b403b3da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:21.632712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee2abf-430d-4efc-b8f4-ea4a0b1f32a4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:21.677190 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f19c2277-1384-494f-aa1f-635b403b3da7 None None] MFA Rules not processed for user `78279cb4fa504d18943cd8807b674cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:21.679084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f19c2277-1384-494f-aa1f-635b403b3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:21.802926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2c5d1-7dce-46aa-a37f-4f639af75c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:21.803847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c5d1-7dce-46aa-a37f-4f639af75c52 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:21.804245 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c5d1-7dce-46aa-a37f-4f639af75c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:21.805008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c5d1-7dce-46aa-a37f-4f639af75c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:21.805404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 832/1666] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Jul 28 03:37:21 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:21.806235 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2c5d1-7dce-46aa-a37f-4f639af75c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:21.806773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2277-1384-494f-aa1f-635b403b3da7 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:21.810161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2c5d1-7dce-46aa-a37f-4f639af75c52 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:21.810598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f19c2277-1384-494f-aa1f-635b403b3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:21.827286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2277-1384-494f-aa1f-635b403b3da7 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:21.836652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:21.837700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:21.838149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:21.838579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:21.839434 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:21.841344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 835/1667] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:21.841996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:21.846843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee04ba-00dc-4c09-b040-0b34f09ef016 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:21.847484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee04ba-00dc-4c09-b040-0b34f09ef016 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:21.848583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee04ba-00dc-4c09-b040-0b34f09ef016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:21.904686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e2ee04ba-00dc-4c09-b040-0b34f09ef016 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:21.907893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e2ee04ba-00dc-4c09-b040-0b34f09ef016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:21.930833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 833/1668] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:21 2021] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:21.932279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 836/1669] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:21.933129 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee04ba-00dc-4c09-b040-0b34f09ef016 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:21.942590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:21.948196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:21.953838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee04ba-00dc-4c09-b040-0b34f09ef016 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.040300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e2ada-056d-4463-9b9a-5edc28829688 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.067179 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.068349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.068612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.069114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] PATH_INFO: `/v3/projects/a77daa82e71b4a0086a5a796c7f3f559/users/c6b497033257447bbefafac0584bcb88/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.108670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77daa82e71b4a0086a5a796c7f3f559, user_id=c6b497033257447bbefafac0584bcb88, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.117643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.148746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 834/1670] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:21 2021] PUT /identity/v3/projects/a77daa82e71b4a0086a5a796c7f3f559/users/c6b497033257447bbefafac0584bcb88/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:22.150219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:22.153559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:22.171240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.172017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.172324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.172580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.173364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.190386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.245647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 837/1671] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:21 2021] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:22.249324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:22.257874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:22.267767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdc56e-80c8-4363-b972-d75426c09d11 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.272045 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d69383-1a3d-42b6-8eec-01b431358a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.272743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69383-1a3d-42b6-8eec-01b431358a33 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.273029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69383-1a3d-42b6-8eec-01b431358a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.273312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69383-1a3d-42b6-8eec-01b431358a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.283303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d69383-1a3d-42b6-8eec-01b431358a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.288454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d69383-1a3d-42b6-8eec-01b431358a33 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.298041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 835/1672] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:22.299180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d69383-1a3d-42b6-8eec-01b431358a33 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:22.378872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d69383-1a3d-42b6-8eec-01b431358a33 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.384369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557803fd-a457-49e6-a16e-109d5382b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.385057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557803fd-a457-49e6-a16e-109d5382b776 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.385421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557803fd-a457-49e6-a16e-109d5382b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.385714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557803fd-a457-49e6-a16e-109d5382b776 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.386585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557803fd-a457-49e6-a16e-109d5382b776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.389931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557803fd-a457-49e6-a16e-109d5382b776 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.403754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 836/1673] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:22 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:22.408342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557803fd-a457-49e6-a16e-109d5382b776 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:22.419678 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557803fd-a457-49e6-a16e-109d5382b776 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.428089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b2d5f-b917-4f3b-8c9e-d7ef9e151b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.428854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2d5f-b917-4f3b-8c9e-d7ef9e151b46 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.429238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2d5f-b917-4f3b-8c9e-d7ef9e151b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.429444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2d5f-b917-4f3b-8c9e-d7ef9e151b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.430238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b2d5f-b917-4f3b-8c9e-d7ef9e151b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.433136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b2d5f-b917-4f3b-8c9e-d7ef9e151b46 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.449933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 837/1674] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:22 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:22.449933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b2d5f-b917-4f3b-8c9e-d7ef9e151b46 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:22.459037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b2d5f-b917-4f3b-8c9e-d7ef9e151b46 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.464433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf332-7839-4ba1-bdcc-892bdc85eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.466125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf332-7839-4ba1-bdcc-892bdc85eeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.466410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf332-7839-4ba1-bdcc-892bdc85eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.466686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf332-7839-4ba1-bdcc-892bdc85eeeb admin admin] PATH_INFO: `/v3/projects/a77daa82e71b4a0086a5a796c7f3f559/users/c6b497033257447bbefafac0584bcb88/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.469491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737bf332-7839-4ba1-bdcc-892bdc85eeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77daa82e71b4a0086a5a796c7f3f559, user_id=c6b497033257447bbefafac0584bcb88, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.472839 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737bf332-7839-4ba1-bdcc-892bdc85eeeb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.473107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261be74-812a-4fc5-807c-655b8f00f5e5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.501059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 838/1675] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:22 2021] PUT /identity/v3/projects/a77daa82e71b4a0086a5a796c7f3f559/users/c6b497033257447bbefafac0584bcb88/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:22.502151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf332-7839-4ba1-bdcc-892bdc85eeeb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:22.579085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf332-7839-4ba1-bdcc-892bdc85eeeb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.609802 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c688d-f837-4fe8-8074-53beca1b6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.611308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c688d-f837-4fe8-8074-53beca1b6aff admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.611850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c688d-f837-4fe8-8074-53beca1b6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.612066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c688d-f837-4fe8-8074-53beca1b6aff admin admin] PATH_INFO: `/v3/projects/4d0b437ee35d47b294abc8a91a66ff2f/users/862031b8fe024e578635e9deb7f3ad11/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.632438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c688d-f837-4fe8-8074-53beca1b6aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0b437ee35d47b294abc8a91a66ff2f, user_id=862031b8fe024e578635e9deb7f3ad11, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.635645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c688d-f837-4fe8-8074-53beca1b6aff admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.658547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f16c5-326e-4280-9917-172cd0bebe5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.660980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f16c5-326e-4280-9917-172cd0bebe5d service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.662784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f16c5-326e-4280-9917-172cd0bebe5d service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.664823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f16c5-326e-4280-9917-172cd0bebe5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.669421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 839/1676] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:22 2021] PUT /identity/v3/projects/4d0b437ee35d47b294abc8a91a66ff2f/users/862031b8fe024e578635e9deb7f3ad11/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:22.670854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f011201-06a8-40e3-877e-8967fb2672b3 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.671213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f011201-06a8-40e3-877e-8967fb2672b3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.671496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f011201-06a8-40e3-877e-8967fb2672b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.688288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f16c5-326e-4280-9917-172cd0bebe5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.693431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f16c5-326e-4280-9917-172cd0bebe5d service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.718496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 838/1677] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:22.719663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f16c5-326e-4280-9917-172cd0bebe5d service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:22.737423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0f011201-06a8-40e3-877e-8967fb2672b3 None None] MFA Rules not processed for user `c6b497033257447bbefafac0584bcb88`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:22.740679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0f011201-06a8-40e3-877e-8967fb2672b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:22.742441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f16c5-326e-4280-9917-172cd0bebe5d service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:22.948410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:22.949108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:22.949926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:22.950281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:22.955303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:22.956976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:22.989582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 840/1678] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:22 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:22.999840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 839/1679] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:22 2021] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:23.000587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f011201-06a8-40e3-877e-8967fb2672b3 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:23.004348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:23.010487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:23.019036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f011201-06a8-40e3-877e-8967fb2672b3 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:23.031299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3603be-50e1-48ab-a475-8314f73da924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:23.033954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3603be-50e1-48ab-a475-8314f73da924 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:23.034288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3603be-50e1-48ab-a475-8314f73da924 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:23.034574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3603be-50e1-48ab-a475-8314f73da924 admin admin] PATH_INFO: `/v3/projects/4d0b437ee35d47b294abc8a91a66ff2f/users/862031b8fe024e578635e9deb7f3ad11/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:23.042479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3603be-50e1-48ab-a475-8314f73da924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0b437ee35d47b294abc8a91a66ff2f, user_id=862031b8fe024e578635e9deb7f3ad11, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:23.048592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3603be-50e1-48ab-a475-8314f73da924 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:23.072953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 841/1680] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:22 2021] PUT /identity/v3/projects/4d0b437ee35d47b294abc8a91a66ff2f/users/862031b8fe024e578635e9deb7f3ad11/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:23.092344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa62d0-2d87-457b-ab83-ae90ab3b1b31 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:23.092653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa62d0-2d87-457b-ab83-ae90ab3b1b31 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:23.093074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa62d0-2d87-457b-ab83-ae90ab3b1b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:23.121986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21737f-e878-490b-b7a8-4d879bcfeda2 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:23.161533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-86aa62d0-2d87-457b-ab83-ae90ab3b1b31 None None] MFA Rules not processed for user `862031b8fe024e578635e9deb7f3ad11`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:23.171329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-86aa62d0-2d87-457b-ab83-ae90ab3b1b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:23.247466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dfa20-1a4a-4be2-bbea-69e674c79a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:23.248702 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfa20-1a4a-4be2-bbea-69e674c79a34 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:23.248847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfa20-1a4a-4be2-bbea-69e674c79a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:23.250341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfa20-1a4a-4be2-bbea-69e674c79a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:23.363265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 842/1681] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:23 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:23.421440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dfa20-1a4a-4be2-bbea-69e674c79a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:23.422907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dfa20-1a4a-4be2-bbea-69e674c79a34 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:23.434968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa62d0-2d87-457b-ab83-ae90ab3b1b31 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:23.436508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-86aa62d0-2d87-457b-ab83-ae90ab3b1b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:23.446980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 840/1682] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:23 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:23.467209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa62d0-2d87-457b-ab83-ae90ab3b1b31 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:23.490767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:23.491961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:23.493678 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:23.494786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:23.532741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:23.537294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:23.567364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dfa20-1a4a-4be2-bbea-69e674c79a34 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:23.583453 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dfa20-1a4a-4be2-bbea-69e674c79a34 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:23.587783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 843/1683] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:23 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:23.602288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:23.602922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:23.603212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:23.605982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:23.614207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:23.845598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:23.850041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:23.886218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:23.888429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:23.905240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 841/1684] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:23 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:24.038945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49683a-4b62-41e5-8211-c30b7ef29e11 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:24.048967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:24.049927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:24.050278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:24.050563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] PATH_INFO: `/v3/users/426b61809c68429b907dddac8ac0d6cd` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:24.051892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426b61809c68429b907dddac8ac0d6cd)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:24.054349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:24.177933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426b61809c68429b907dddac8ac0d6cd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.214485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426b61809c68429b907dddac8ac0d6cd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.228547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426b61809c68429b907dddac8ac0d6cd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.233413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426b61809c68429b907dddac8ac0d6cd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.253336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e2f61ac0-9280-4d20-8134-f2359a2a6cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426b61809c68429b907dddac8ac0d6cd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.270503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 844/1685] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:23 2021] DELETE /identity/v3/users/426b61809c68429b907dddac8ac0d6cd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:24.361393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:24.379606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dde9f1-8ade-42c0-a465-78ffed8838f5 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:24.470977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:24.472197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:24.472453 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:24.472816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] PATH_INFO: `/v3/users/7825eab50bc048d0a8e1bcd5f751adab` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:24.474112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7825eab50bc048d0a8e1bcd5f751adab)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:24.476896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:24.561330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7825eab50bc048d0a8e1bcd5f751adab'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.604936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7825eab50bc048d0a8e1bcd5f751adab'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.608998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7825eab50bc048d0a8e1bcd5f751adab'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.629848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7825eab50bc048d0a8e1bcd5f751adab'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.632172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7825eab50bc048d0a8e1bcd5f751adab'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:24.688058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 842/1686] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:24 2021] DELETE /identity/v3/users/7825eab50bc048d0a8e1bcd5f751adab => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:24.692512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6637-1c8f-4a7b-9bf3-b95d9407320a None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:24.693065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6637-1c8f-4a7b-9bf3-b95d9407320a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:24.693181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6637-1c8f-4a7b-9bf3-b95d9407320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:24.749105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-bf6e6637-1c8f-4a7b-9bf3-b95d9407320a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:24.750199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bf6e6637-1c8f-4a7b-9bf3-b95d9407320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:24.941042 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 845/1687] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:25.001068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:25.002532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:25.158069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05417909-74ce-4cb5-9835-ac59b245aaf3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:25.165001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:25.165698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:25.165982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:25.166260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:25.189595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:25.192985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:25.217622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 843/1688] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:25.744918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e6637-1c8f-4a7b-9bf3-b95d9407320a None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:25.746959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bf6e6637-1c8f-4a7b-9bf3-b95d9407320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:25.769029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e6637-1c8f-4a7b-9bf3-b95d9407320a None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:25.782090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:25.782978 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:25.783262 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:25.783536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] PATH_INFO: `/v3/projects/972cc04871274ca78d7f9ff27698c242` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:25.784754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=972cc04871274ca78d7f9ff27698c242)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:25.786710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:25.812252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:25.815254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:25.832096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2ac6a-6c56-4c67-956c-db78b5dfaf0f service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:25.852468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:25.860837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:25.861370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:25.861794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] PATH_INFO: `/v3/projects/e7fe8d51b9f14c70b69491b1f4195b9b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:25.863250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fe8d51b9f14c70b69491b1f4195b9b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:25.865616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:25.917182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972cc04871274ca78d7f9ff27698c242', 'request_id': 'req-8b7bba5f-56bc-49b1-b131-a52c216dc62b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:25.926074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972cc04871274ca78d7f9ff27698c242', 'request_id': 'req-8b7bba5f-56bc-49b1-b131-a52c216dc62b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:25.936210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972cc04871274ca78d7f9ff27698c242', 'request_id': 'req-8b7bba5f-56bc-49b1-b131-a52c216dc62b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:25.954809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] The token cache is being invalidate because project 972cc04871274ca78d7f9ff27698c242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:25.955410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:25.957245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8b7bba5f-56bc-49b1-b131-a52c216dc62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:25.959582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 846/1689] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:25 2021] DELETE /identity/v3/projects/972cc04871274ca78d7f9ff27698c242 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:25.961556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42ab4-daef-4fc4-969f-c8ab5c2157b2 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:25.962608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42ab4-daef-4fc4-969f-c8ab5c2157b2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:25.962947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42ab4-daef-4fc4-969f-c8ab5c2157b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:26.039823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c5f42ab4-daef-4fc4-969f-c8ab5c2157b2 None None] MFA Rules not processed for user `faf7da464d4c44db918dd6c5076846e9`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:26.041045 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c5f42ab4-daef-4fc4-969f-c8ab5c2157b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:26.052045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fe8d51b9f14c70b69491b1f4195b9b', 'request_id': 'req-3e2775f6-59c7-49d1-b181-d0f59d91dd64'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.073359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fe8d51b9f14c70b69491b1f4195b9b', 'request_id': 'req-3e2775f6-59c7-49d1-b181-d0f59d91dd64'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.088339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fe8d51b9f14c70b69491b1f4195b9b', 'request_id': 'req-3e2775f6-59c7-49d1-b181-d0f59d91dd64'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.108904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] The token cache is being invalidate because project e7fe8d51b9f14c70b69491b1f4195b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:26.109712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.112602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.116373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 844/1690] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:25 2021] DELETE /identity/v3/projects/e7fe8d51b9f14c70b69491b1f4195b9b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:26.126205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:26.129219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:26.250466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 847/1691] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:25 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:26.250466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42ab4-daef-4fc4-969f-c8ab5c2157b2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:26.253156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c5f42ab4-daef-4fc4-969f-c8ab5c2157b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:26.366226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2775f6-59c7-49d1-b181-d0f59d91dd64 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:26.378076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:26.382060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:26.382438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:26.382913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] PATH_INFO: `/v3/users/0cde3a9df31e4282bfdf57cb0f42f033` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:26.387193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cde3a9df31e4282bfdf57cb0f42f033)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:26.398026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:26.423061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42ab4-daef-4fc4-969f-c8ab5c2157b2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:26.435632 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:26.436574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:26.436880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:26.437128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] PATH_INFO: `/v3/users/5b0b03146bb84d36bba39be334f0e114` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:26.440905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0b03146bb84d36bba39be334f0e114)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:26.444478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:26.528275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cde3a9df31e4282bfdf57cb0f42f033'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.549260 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0b03146bb84d36bba39be334f0e114'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.578337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0b03146bb84d36bba39be334f0e114'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.590747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cde3a9df31e4282bfdf57cb0f42f033'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.595433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cde3a9df31e4282bfdf57cb0f42f033'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.596372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0b03146bb84d36bba39be334f0e114'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.597761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0b03146bb84d36bba39be334f0e114'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.623732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0b03146bb84d36bba39be334f0e114'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.625123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cde3a9df31e4282bfdf57cb0f42f033'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.628501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 848/1692] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:26 2021] DELETE /identity/v3/users/5b0b03146bb84d36bba39be334f0e114 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:26.628650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78f56eab-3428-46e2-9e54-421991a83148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cde3a9df31e4282bfdf57cb0f42f033'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:26.633307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:26.638410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:26.676332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 845/1693] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:26 2021] DELETE /identity/v3/users/0cde3a9df31e4282bfdf57cb0f42f033 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:26.677607 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c046c-52b2-459f-a83c-37dd03d46d64 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:26.678610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c046c-52b2-459f-a83c-37dd03d46d64 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:26.678895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c046c-52b2-459f-a83c-37dd03d46d64 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:26.685821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 846/1694] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:37:26 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:37:26.748915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271ae3e-6844-4627-ab1e-77ec86690368 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:26.749306 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271ae3e-6844-4627-ab1e-77ec86690368 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:26.749644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271ae3e-6844-4627-ab1e-77ec86690368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:26.812761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-0271ae3e-6844-4627-ab1e-77ec86690368 None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:26.827517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0834c-523c-4b6b-a5b0-bbdaf542505c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:26.830399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0271ae3e-6844-4627-ab1e-77ec86690368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:26.982594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:26.983325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:26.983561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:26.983868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:26.988506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:27.030821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 847/1695] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:37:26 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:27.032006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271ae3e-6844-4627-ab1e-77ec86690368 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:27.033693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0271ae3e-6844-4627-ab1e-77ec86690368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:27.114769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:27.123555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:27.145705 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 849/1696] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:26 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:27.168621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271ae3e-6844-4627-ab1e-77ec86690368 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:27.190159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:27.191352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:27.191831 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:27.192258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] PATH_INFO: `/v3/projects/6fa3f6372cde471dbf0a48befa921c43` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:27.193620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa3f6372cde471dbf0a48befa921c43)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:27.195749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:27.289299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa3f6372cde471dbf0a48befa921c43', 'request_id': 'req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.307010 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa3f6372cde471dbf0a48befa921c43', 'request_id': 'req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.316282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa3f6372cde471dbf0a48befa921c43', 'request_id': 'req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.338225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] The token cache is being invalidate because project 6fa3f6372cde471dbf0a48befa921c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:27.338781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.342173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.344249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 848/1697] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:27 2021] DELETE /identity/v3/projects/6fa3f6372cde471dbf0a48befa921c43 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:27.348295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:27.362442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb787f81-98a0-4533-bede-6afb5003c3c7 service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:27.472747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:27.478177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:27.479254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:27.479598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] PATH_INFO: `/v3/users/862031b8fe024e578635e9deb7f3ad11` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:27.486939 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=862031b8fe024e578635e9deb7f3ad11)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:27.489249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:27.584859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862031b8fe024e578635e9deb7f3ad11'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.628282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862031b8fe024e578635e9deb7f3ad11'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.638172 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862031b8fe024e578635e9deb7f3ad11'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.638914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862031b8fe024e578635e9deb7f3ad11'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.657444 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862031b8fe024e578635e9deb7f3ad11'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:27.672836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 850/1698] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:27 2021] DELETE /identity/v3/users/862031b8fe024e578635e9deb7f3ad11 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:27.961117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:27.962762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:27.986253 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcc1f4-ee96-4f6d-aae2-db46bf64376b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:28.062626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:28.064057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:28.177919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:28.178991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:28.179870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:28.180482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] PATH_INFO: `/v3/users/2ad0b3b5953841348c278af063e7cc57` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:28.182232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad0b3b5953841348c278af063e7cc57)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:28.184847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:28.242227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bb98-de14-40f7-9ab2-fc3236545cc8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:28.256154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1941c-7817-4071-866e-59c5ea53695b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:28.259024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1941c-7817-4071-866e-59c5ea53695b service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:28.260451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1941c-7817-4071-866e-59c5ea53695b service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:28.262154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1941c-7817-4071-866e-59c5ea53695b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:28.265487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1ae1941c-7817-4071-866e-59c5ea53695b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:28.297153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1941c-7817-4071-866e-59c5ea53695b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:28.300234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad0b3b5953841348c278af063e7cc57'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.301228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1941c-7817-4071-866e-59c5ea53695b service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:28.328073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 851/1699] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:28 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:28.358189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad0b3b5953841348c278af063e7cc57'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.362018 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad0b3b5953841348c278af063e7cc57'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.384736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad0b3b5953841348c278af063e7cc57'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.389201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad0b3b5953841348c278af063e7cc57'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.421454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 849/1700] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:27 2021] DELETE /identity/v3/users/2ad0b3b5953841348c278af063e7cc57 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:28.426552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff584-c4a4-4f2b-9007-7c2d0fe7ce05 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:28.426552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff584-c4a4-4f2b-9007-7c2d0fe7ce05 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:28.427039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff584-c4a4-4f2b-9007-7c2d0fe7ce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:28.469860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-69aff584-c4a4-4f2b-9007-7c2d0fe7ce05 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:28.471150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-69aff584-c4a4-4f2b-9007-7c2d0fe7ce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:28.490821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:28.492606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:28.634691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 852/1701] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:28.639971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f482-92e8-4024-9ece-99de6e700c7f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:28.640269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f482-92e8-4024-9ece-99de6e700c7f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:28.640609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f482-92e8-4024-9ece-99de6e700c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:28.676464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8f01-6984-4f1c-84f0-e411d2f80e8d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:28.681450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3251f482-92e8-4024-9ece-99de6e700c7f None None] MFA Rules not processed for user `fd82b48aabbb419cb891867d0b1a57e0`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:28.684828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3251f482-92e8-4024-9ece-99de6e700c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:28.711058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:28.712661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:28.713051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:28.713426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] PATH_INFO: `/v3/projects/e261a46fd82841c3856e8c170df3c750` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:28.716632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e261a46fd82841c3856e8c170df3c750)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:28.718682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:28.855916 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 853/1702] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:28 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:28.858173 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251f482-92e8-4024-9ece-99de6e700c7f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:28.862495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3251f482-92e8-4024-9ece-99de6e700c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:28.889068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e261a46fd82841c3856e8c170df3c750', 'request_id': 'req-fae087dd-531c-4d4c-a588-4b5f749d37ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.904731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e261a46fd82841c3856e8c170df3c750', 'request_id': 'req-fae087dd-531c-4d4c-a588-4b5f749d37ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.923114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e261a46fd82841c3856e8c170df3c750', 'request_id': 'req-fae087dd-531c-4d4c-a588-4b5f749d37ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.963094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] The token cache is being invalidate because project e261a46fd82841c3856e8c170df3c750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:28.968537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.971844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fae087dd-531c-4d4c-a588-4b5f749d37ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:28.977205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 850/1703] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:28 2021] DELETE /identity/v3/projects/e261a46fd82841c3856e8c170df3c750 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:28.984361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafccc-5344-4328-b51f-401b8161c995 None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:28.984932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafccc-5344-4328-b51f-401b8161c995 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:28.985491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafccc-5344-4328-b51f-401b8161c995 None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:28.987825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 851/1704] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:37:28 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:37:28.989015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fafccc-5344-4328-b51f-401b8161c995 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:28.991054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d6fafccc-5344-4328-b51f-401b8161c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:29.066615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251f482-92e8-4024-9ece-99de6e700c7f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:29.161609 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fafccc-5344-4328-b51f-401b8161c995 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:29.180653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538674f-268d-43af-b940-0310a810cf49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:29.184723 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538674f-268d-43af-b940-0310a810cf49 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:29.185055 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538674f-268d-43af-b940-0310a810cf49 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:29.185344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538674f-268d-43af-b940-0310a810cf49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:29.195849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6538674f-268d-43af-b940-0310a810cf49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:29.296123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7efa2f-b882-43af-822f-9674a51a4c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:29.296958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7efa2f-b882-43af-822f-9674a51a4c27 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:29.297347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7efa2f-b882-43af-822f-9674a51a4c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:29.297723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7efa2f-b882-43af-822f-9674a51a4c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:29.313827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4e7efa2f-b882-43af-822f-9674a51a4c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:29.388496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538674f-268d-43af-b940-0310a810cf49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:29.394149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538674f-268d-43af-b940-0310a810cf49 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:29.419246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 852/1705] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:28 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:29.420739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede420cd-32cc-4a14-b194-39acb9dda8e9 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:29.421034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede420cd-32cc-4a14-b194-39acb9dda8e9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:29.421318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede420cd-32cc-4a14-b194-39acb9dda8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:29.476595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ede420cd-32cc-4a14-b194-39acb9dda8e9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:29.477820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ede420cd-32cc-4a14-b194-39acb9dda8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:29.508500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7efa2f-b882-43af-822f-9674a51a4c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:29.510195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7efa2f-b882-43af-822f-9674a51a4c27 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:29.510673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 853/1706] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:29.512349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f0735-c0a5-4cfc-ae0e-6b536d557059 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:29.512647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f0735-c0a5-4cfc-ae0e-6b536d557059 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:29.512930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f0735-c0a5-4cfc-ae0e-6b536d557059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:29.557230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 854/1707] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:29.559561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03dc3e-d388-4bfe-8a6b-ee40b17345f7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:29.559966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03dc3e-d388-4bfe-8a6b-ee40b17345f7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:29.560351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03dc3e-d388-4bfe-8a6b-ee40b17345f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:29.573264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-966f0735-c0a5-4cfc-ae0e-6b536d557059 None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:29.575098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-966f0735-c0a5-4cfc-ae0e-6b536d557059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:29.606401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 854/1708] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:37:29 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:29.611516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9c03dc3e-d388-4bfe-8a6b-ee40b17345f7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:29.616197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9c03dc3e-d388-4bfe-8a6b-ee40b17345f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:29.655131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 855/1709] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:29.658797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f0735-c0a5-4cfc-ae0e-6b536d557059 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:29.675268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f0735-c0a5-4cfc-ae0e-6b536d557059 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:29.720490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:29.721575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:29.722081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:29.722564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:29.723515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:29.729996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:29.732566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:29.738021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03dc3e-d388-4bfe-8a6b-ee40b17345f7 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:29.739619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9c03dc3e-d388-4bfe-8a6b-ee40b17345f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:29.758302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03dc3e-d388-4bfe-8a6b-ee40b17345f7 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:29.773812 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:29.774764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:29.775098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:29.775379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] PATH_INFO: `/v3/projects/7f9388f36d0243f7928a46570ae894da` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:29.778254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9388f36d0243f7928a46570ae894da)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:29.784243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:29.811383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 855/1710] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:29.821009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:29.866164 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcc25c-1800-485f-a30d-1e0d7c087e3d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:29.885823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a60d-406c-45d4-a603-a98cd950cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:29.886747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a60d-406c-45d4-a603-a98cd950cb4c admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:29.887124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a60d-406c-45d4-a603-a98cd950cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:29.887699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a60d-406c-45d4-a603-a98cd950cb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:29.888669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a60d-406c-45d4-a603-a98cd950cb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:29.892632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a60d-406c-45d4-a603-a98cd950cb4c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:29.904543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9388f36d0243f7928a46570ae894da', 'request_id': 'req-71f67fb6-5751-4d92-b34d-6622801e87c9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:29.940600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9388f36d0243f7928a46570ae894da', 'request_id': 'req-71f67fb6-5751-4d92-b34d-6622801e87c9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:29.976997 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9388f36d0243f7928a46570ae894da', 'request_id': 'req-71f67fb6-5751-4d92-b34d-6622801e87c9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:29.987993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 856/1711] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:29 2021] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:29.988921 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a60d-406c-45d4-a603-a98cd950cb4c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:30.031238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] The token cache is being invalidate because project 7f9388f36d0243f7928a46570ae894da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:30.031534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:30.035669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-71f67fb6-5751-4d92-b34d-6622801e87c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:30.040611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 856/1712] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:29 2021] DELETE /identity/v3/projects/7f9388f36d0243f7928a46570ae894da => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:30.050127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cca5-6455-4c01-8f83-1d129e523189 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.050583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cca5-6455-4c01-8f83-1d129e523189 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.051078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cca5-6455-4c01-8f83-1d129e523189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.140204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-4242cca5-6455-4c01-8f83-1d129e523189 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:30.141687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4242cca5-6455-4c01-8f83-1d129e523189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:30.185372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 857/1713] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:30.186349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242cca5-6455-4c01-8f83-1d129e523189 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:30.195693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4242cca5-6455-4c01-8f83-1d129e523189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:30.197917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a60d-406c-45d4-a603-a98cd950cb4c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:30.213412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:30.214119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.214413 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.215253 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.224042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:30.227155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:30.284761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 857/1714] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:29 2021] POST /identity/v3/users => generated 285 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:30.285773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:30.288748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:30.323423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418352-5dfb-44db-a0a3-9bcd477f6634 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:30.341950 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:30.343439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.343745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.344277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] PATH_INFO: `/v3/projects/4d0b437ee35d47b294abc8a91a66ff2f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.349657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0b437ee35d47b294abc8a91a66ff2f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:30.351616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:30.428590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242cca5-6455-4c01-8f83-1d129e523189 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:30.439471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbc25a-525d-45fa-a7a3-85534a8bcfa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:30.448168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc25a-525d-45fa-a7a3-85534a8bcfa9 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.448569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc25a-525d-45fa-a7a3-85534a8bcfa9 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.448856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc25a-525d-45fa-a7a3-85534a8bcfa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.454903 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b9cbc25a-525d-45fa-a7a3-85534a8bcfa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:30.492253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc25a-525d-45fa-a7a3-85534a8bcfa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:30.497423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc25a-525d-45fa-a7a3-85534a8bcfa9 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:30.508819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0b437ee35d47b294abc8a91a66ff2f', 'request_id': 'req-3a420055-f4bd-4545-ad32-cacbcee9ea34'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:30.522603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0b437ee35d47b294abc8a91a66ff2f', 'request_id': 'req-3a420055-f4bd-4545-ad32-cacbcee9ea34'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:30.523555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 858/1715] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:30.535616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0b437ee35d47b294abc8a91a66ff2f', 'request_id': 'req-3a420055-f4bd-4545-ad32-cacbcee9ea34'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:30.553365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f951c-d912-4ee7-b6d5-ac2bdc1ff967 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.553783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f951c-d912-4ee7-b6d5-ac2bdc1ff967 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.553885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] The token cache is being invalidate because project 4d0b437ee35d47b294abc8a91a66ff2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:30.554074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f951c-d912-4ee7-b6d5-ac2bdc1ff967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.554165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:30.554754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:30.556388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 858/1716] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:30 2021] DELETE /identity/v3/projects/4d0b437ee35d47b294abc8a91a66ff2f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:30.557174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:30.562799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:30.665807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f97f951c-d912-4ee7-b6d5-ac2bdc1ff967 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:30.674219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f97f951c-d912-4ee7-b6d5-ac2bdc1ff967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:30.794105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a420055-f4bd-4545-ad32-cacbcee9ea34 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:30.805595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bf59a-d25d-47e8-8ad6-643e6f929d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:30.806303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf59a-d25d-47e8-8ad6-643e6f929d57 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.806595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf59a-d25d-47e8-8ad6-643e6f929d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.806871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf59a-d25d-47e8-8ad6-643e6f929d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.807610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bf59a-d25d-47e8-8ad6-643e6f929d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:30.813518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bf59a-d25d-47e8-8ad6-643e6f929d57 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:30.837738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 859/1717] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:30.840886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dfd90-d729-461b-b0a6-bd7d9302cd34 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.841180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dfd90-d729-461b-b0a6-bd7d9302cd34 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.841464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dfd90-d729-461b-b0a6-bd7d9302cd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.893397 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-642dfd90-d729-461b-b0a6-bd7d9302cd34 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:30.894629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-642dfd90-d729-461b-b0a6-bd7d9302cd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:30.931271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 860/1718] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:30.931271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dfd90-d729-461b-b0a6-bd7d9302cd34 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:30.976125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dfd90-d729-461b-b0a6-bd7d9302cd34 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:30.991077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e2f9-00ef-4c4e-903e-f88697fd0822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:30.991077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e2f9-00ef-4c4e-903e-f88697fd0822 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.991077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e2f9-00ef-4c4e-903e-f88697fd0822 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.991077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e2f9-00ef-4c4e-903e-f88697fd0822 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.992136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23e2f9-00ef-4c4e-903e-f88697fd0822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:30.993100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 859/1719] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:30.995366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799185-8cb4-441e-9d9f-ffb4ad122803 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:30.996056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799185-8cb4-441e-9d9f-ffb4ad122803 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:30.996664 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799185-8cb4-441e-9d9f-ffb4ad122803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:30.997099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23e2f9-00ef-4c4e-903e-f88697fd0822 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.032957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-92799185-8cb4-441e-9d9f-ffb4ad122803 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:31.034421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-92799185-8cb4-441e-9d9f-ffb4ad122803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:31.050745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 861/1720] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:31.053248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e2f9-00ef-4c4e-903e-f88697fd0822 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.053679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 860/1721] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:31.054560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799185-8cb4-441e-9d9f-ffb4ad122803 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.076719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e2f9-00ef-4c4e-903e-f88697fd0822 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:31.078921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799185-8cb4-441e-9d9f-ffb4ad122803 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:31.091421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d1556-1076-4078-afa8-7523b9851c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:31.092411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d1556-1076-4078-afa8-7523b9851c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.092758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d1556-1076-4078-afa8-7523b9851c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.093071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d1556-1076-4078-afa8-7523b9851c89 admin admin] PATH_INFO: `/v3/projects/cc5dda143d454349b51b81f6861ec5fb/users/5bba0914e8694fe9a92a6b775424f8c6/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.096538 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:31.097229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.099579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.100702 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.102392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:31.103546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:31.110468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d1556-1076-4078-afa8-7523b9851c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5dda143d454349b51b81f6861ec5fb, user_id=5bba0914e8694fe9a92a6b775424f8c6, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:31.111465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.113653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d1556-1076-4078-afa8-7523b9851c89 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.136994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 861/1722] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:31 2021] PUT /identity/v3/projects/cc5dda143d454349b51b81f6861ec5fb/users/5bba0914e8694fe9a92a6b775424f8c6/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:31.138900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d1556-1076-4078-afa8-7523b9851c89 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.184588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 862/1723] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:31.189210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.206632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358d3b0-fad2-4a66-9b01-acd0f80bfe1a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:31.297780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed287066-71eb-47b9-9951-fa0d2b929105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:31.299151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287066-71eb-47b9-9951-fa0d2b929105 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.299742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287066-71eb-47b9-9951-fa0d2b929105 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.300228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287066-71eb-47b9-9951-fa0d2b929105 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.301472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed287066-71eb-47b9-9951-fa0d2b929105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:31.306906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d1556-1076-4078-afa8-7523b9851c89 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:31.314241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed287066-71eb-47b9-9951-fa0d2b929105 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.316668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc78da-02ed-4cba-8632-b4f9671b7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:31.317406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc78da-02ed-4cba-8632-b4f9671b7efc admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.317691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc78da-02ed-4cba-8632-b4f9671b7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.317967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc78da-02ed-4cba-8632-b4f9671b7efc admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.318698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc78da-02ed-4cba-8632-b4f9671b7efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:31.322051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc78da-02ed-4cba-8632-b4f9671b7efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:31.328162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc78da-02ed-4cba-8632-b4f9671b7efc admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.357878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 862/1724] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:31.362898 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a78366-8371-47d4-957d-0a0f47b89ea9 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.363145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a78366-8371-47d4-957d-0a0f47b89ea9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.366838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a78366-8371-47d4-957d-0a0f47b89ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.388476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 863/1725] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:31 2021] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:31.388476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed287066-71eb-47b9-9951-fa0d2b929105 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.431056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-93a78366-8371-47d4-957d-0a0f47b89ea9 None None] MFA Rules not processed for user `5bba0914e8694fe9a92a6b775424f8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:31.432429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-93a78366-8371-47d4-957d-0a0f47b89ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:31.538147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed287066-71eb-47b9-9951-fa0d2b929105 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:31.559797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c76ce-d8e3-4190-aa15-abdd1e9c0a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:31.560583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c76ce-d8e3-4190-aa15-abdd1e9c0a2b admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.560866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c76ce-d8e3-4190-aa15-abdd1e9c0a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.561139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c76ce-d8e3-4190-aa15-abdd1e9c0a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.561847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c76ce-d8e3-4190-aa15-abdd1e9c0a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:31.563789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c76ce-d8e3-4190-aa15-abdd1e9c0a2b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.582148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 863/1726] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:31 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:31.582969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a78366-8371-47d4-957d-0a0f47b89ea9 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.601585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a78366-8371-47d4-957d-0a0f47b89ea9 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:31.610974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120051d-f56b-4c8c-9123-878a7030492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:31.616034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120051d-f56b-4c8c-9123-878a7030492b admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.616364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120051d-f56b-4c8c-9123-878a7030492b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.616635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120051d-f56b-4c8c-9123-878a7030492b admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.617874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120051d-f56b-4c8c-9123-878a7030492b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:31.620487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120051d-f56b-4c8c-9123-878a7030492b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.635159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 864/1727] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:31 2021] POST /identity/v3/projects => generated 355 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:31.639683 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c76ce-d8e3-4190-aa15-abdd1e9c0a2b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.701936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 864/1728] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:31 2021] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:31.702840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120051d-f56b-4c8c-9123-878a7030492b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.730014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120051d-f56b-4c8c-9123-878a7030492b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:31.838981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c76ce-d8e3-4190-aa15-abdd1e9c0a2b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:31.852402 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c730c-af4d-452a-b944-4248a73b12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:31.853093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c730c-af4d-452a-b944-4248a73b12ee admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.853667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c730c-af4d-452a-b944-4248a73b12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.853955 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c730c-af4d-452a-b944-4248a73b12ee admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.854775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c730c-af4d-452a-b944-4248a73b12ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:31.872130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c730c-af4d-452a-b944-4248a73b12ee admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.891217 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812945d-2b1e-4c54-8c97-8af8ed908d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:31.893938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812945d-2b1e-4c54-8c97-8af8ed908d8f admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:31.894400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812945d-2b1e-4c54-8c97-8af8ed908d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:31.895492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812945d-2b1e-4c54-8c97-8af8ed908d8f admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:31.897881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812945d-2b1e-4c54-8c97-8af8ed908d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:31.902625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812945d-2b1e-4c54-8c97-8af8ed908d8f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:31.941265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 865/1729] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:31 2021] POST /identity/v3/projects => generated 369 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:31.942273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c730c-af4d-452a-b944-4248a73b12ee admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.953339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 865/1730] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:31 2021] POST /identity/v3/users => generated 278 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:31.954320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812945d-2b1e-4c54-8c97-8af8ed908d8f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:31.974065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812945d-2b1e-4c54-8c97-8af8ed908d8f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.104496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c730c-af4d-452a-b944-4248a73b12ee admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.110239 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cd3bd-81a6-473e-a64a-649db0ba841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.111939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cd3bd-81a6-473e-a64a-649db0ba841d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.112238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cd3bd-81a6-473e-a64a-649db0ba841d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.112523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cd3bd-81a6-473e-a64a-649db0ba841d admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.113393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cd3bd-81a6-473e-a64a-649db0ba841d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.115620 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cd3bd-81a6-473e-a64a-649db0ba841d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.122041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82208ed1-04f6-4b84-87c2-5fbdb4d12eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.123104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208ed1-04f6-4b84-87c2-5fbdb4d12eaa admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.124106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208ed1-04f6-4b84-87c2-5fbdb4d12eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.124877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208ed1-04f6-4b84-87c2-5fbdb4d12eaa admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.127297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82208ed1-04f6-4b84-87c2-5fbdb4d12eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.128544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 866/1731] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:32.129508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cd3bd-81a6-473e-a64a-649db0ba841d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.131094 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82208ed1-04f6-4b84-87c2-5fbdb4d12eaa admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.142958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cd3bd-81a6-473e-a64a-649db0ba841d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.152722 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292c78-1176-4957-b2c7-5245079d5180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.153700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292c78-1176-4957-b2c7-5245079d5180 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.153991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292c78-1176-4957-b2c7-5245079d5180 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.154487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292c78-1176-4957-b2c7-5245079d5180 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.155293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292c78-1176-4957-b2c7-5245079d5180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.157618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292c78-1176-4957-b2c7-5245079d5180 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.172988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 867/1732] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:32.174964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292c78-1176-4957-b2c7-5245079d5180 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.185522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 866/1733] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:31 2021] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:32.186904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82208ed1-04f6-4b84-87c2-5fbdb4d12eaa admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.194499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292c78-1176-4957-b2c7-5245079d5180 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.204618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1734ce-d0a3-42fc-a895-6151621d10b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.205626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1734ce-d0a3-42fc-a895-6151621d10b6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.205751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1734ce-d0a3-42fc-a895-6151621d10b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.205973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1734ce-d0a3-42fc-a895-6151621d10b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.206713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1734ce-d0a3-42fc-a895-6151621d10b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.208546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1734ce-d0a3-42fc-a895-6151621d10b6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.216199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82208ed1-04f6-4b84-87c2-5fbdb4d12eaa admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.224309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 868/1734] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:32.225104 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1734ce-d0a3-42fc-a895-6151621d10b6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.230936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2710-26ca-42d8-ba07-c2a6ee0f9625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.231877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2710-26ca-42d8-ba07-c2a6ee0f9625 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.233774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2710-26ca-42d8-ba07-c2a6ee0f9625 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.234068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2710-26ca-42d8-ba07-c2a6ee0f9625 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.234821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2710-26ca-42d8-ba07-c2a6ee0f9625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.236476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2710-26ca-42d8-ba07-c2a6ee0f9625 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.239937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1734ce-d0a3-42fc-a895-6151621d10b6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.247231 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c18266-4e7c-40c2-bbe7-557aaa805448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.248585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c18266-4e7c-40c2-bbe7-557aaa805448 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.248913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c18266-4e7c-40c2-bbe7-557aaa805448 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.249333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c18266-4e7c-40c2-bbe7-557aaa805448 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.264224 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c18266-4e7c-40c2-bbe7-557aaa805448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.265113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 867/1735] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:32.266021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2710-26ca-42d8-ba07-c2a6ee0f9625 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.270179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c18266-4e7c-40c2-bbe7-557aaa805448 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.288299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 869/1736] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:32.289934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c18266-4e7c-40c2-bbe7-557aaa805448 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.301871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c18266-4e7c-40c2-bbe7-557aaa805448 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.308042 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2710-26ca-42d8-ba07-c2a6ee0f9625 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.320281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a7279-d2be-43ea-be24-ecc54543736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.321677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a7279-d2be-43ea-be24-ecc54543736b admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.321963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a7279-d2be-43ea-be24-ecc54543736b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.322240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a7279-d2be-43ea-be24-ecc54543736b admin admin] PATH_INFO: `/v3/projects/869e0ee2e07646ea9d6eb4993c675d9e/users/67c19fd11ced473fa0f66e8de642fb51/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.329501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ea20b-fe8a-4ddd-85da-84c3efd81ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.332342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea20b-fe8a-4ddd-85da-84c3efd81ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.332622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea20b-fe8a-4ddd-85da-84c3efd81ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.335619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea20b-fe8a-4ddd-85da-84c3efd81ec2 admin admin] PATH_INFO: `/v3/projects/5ee6db99e7b8406ba6c2e17f1b070fe2/users/c4e3440a6d0544efbadd98059e84ffe8/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.364043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a7279-d2be-43ea-be24-ecc54543736b admin admin] RBAC: Authorizing `identity:create_grant(project_id=869e0ee2e07646ea9d6eb4993c675d9e, user_id=67c19fd11ced473fa0f66e8de642fb51, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.366187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ea20b-fe8a-4ddd-85da-84c3efd81ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee6db99e7b8406ba6c2e17f1b070fe2, user_id=c4e3440a6d0544efbadd98059e84ffe8, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.369033 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a7279-d2be-43ea-be24-ecc54543736b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.380825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ea20b-fe8a-4ddd-85da-84c3efd81ec2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.418853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 868/1737] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:32 2021] PUT /identity/v3/projects/869e0ee2e07646ea9d6eb4993c675d9e/users/67c19fd11ced473fa0f66e8de642fb51/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:32.421358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 870/1738] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:32 2021] PUT /identity/v3/projects/5ee6db99e7b8406ba6c2e17f1b070fe2/users/c4e3440a6d0544efbadd98059e84ffe8/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:32.421816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a7279-d2be-43ea-be24-ecc54543736b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.424707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4c2e-d80e-4378-b7af-5f9a6d64e9ae None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.424707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4c2e-d80e-4378-b7af-5f9a6d64e9ae None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.424988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4c2e-d80e-4378-b7af-5f9a6d64e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.466128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d9ef4c2e-d80e-4378-b7af-5f9a6d64e9ae None None] MFA Rules not processed for user `67c19fd11ced473fa0f66e8de642fb51`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:32.467557 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d9ef4c2e-d80e-4378-b7af-5f9a6d64e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:32.557966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a7279-d2be-43ea-be24-ecc54543736b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.584836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 871/1739] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:32 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:32.586505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0933b3-fdb2-4eb0-ac13-80768e368c85 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.586925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0933b3-fdb2-4eb0-ac13-80768e368c85 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.587331 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0933b3-fdb2-4eb0-ac13-80768e368c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.630296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-0b0933b3-fdb2-4eb0-ac13-80768e368c85 None None] MFA Rules not processed for user `c4e3440a6d0544efbadd98059e84ffe8`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:32.631482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0b0933b3-fdb2-4eb0-ac13-80768e368c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:32.681529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.682593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.682991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.683976 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] PATH_INFO: `/v3/projects/267ad7ddf27d47baa2ee1feae42b4751/users/dd1ae29536ae4164a6157e5c65d5d966/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.735200 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267ad7ddf27d47baa2ee1feae42b4751, user_id=dd1ae29536ae4164a6157e5c65d5d966, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.740558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.753664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 872/1740] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:32 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:32.754573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0933b3-fdb2-4eb0-ac13-80768e368c85 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.770303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 869/1741] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:32 2021] PUT /identity/v3/projects/267ad7ddf27d47baa2ee1feae42b4751/users/dd1ae29536ae4164a6157e5c65d5d966/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:32.771443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:32.773360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:32.774331 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0933b3-fdb2-4eb0-ac13-80768e368c85 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.900068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9328-3d9e-4885-901c-49a00a555634 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:32.905845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.906349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9abeca-1f1b-46be-9948-fe3587c67694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:32.906729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.907007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.907125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9abeca-1f1b-46be-9948-fe3587c67694 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:32.907281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] PATH_INFO: `/v3/projects/cfdca16d0bec4e48b9569e373b80dd7a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.907457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9abeca-1f1b-46be-9948-fe3587c67694 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:32.907792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9abeca-1f1b-46be-9948-fe3587c67694 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:32.908501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdca16d0bec4e48b9569e373b80dd7a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.908609 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9abeca-1f1b-46be-9948-fe3587c67694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:32.910889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.915528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9abeca-1f1b-46be-9948-fe3587c67694 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:32.959827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 873/1742] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:32 2021] POST /identity/v3/projects => generated 389 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:32.961032 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9abeca-1f1b-46be-9948-fe3587c67694 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.020331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdca16d0bec4e48b9569e373b80dd7a', 'request_id': 'req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.031205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdca16d0bec4e48b9569e373b80dd7a', 'request_id': 'req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.052906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdca16d0bec4e48b9569e373b80dd7a', 'request_id': 'req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.073848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] The token cache is being invalidate because project cfdca16d0bec4e48b9569e373b80dd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:33.075447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.076222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.080899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 870/1743] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:32 2021] DELETE /identity/v3/projects/cfdca16d0bec4e48b9569e373b80dd7a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:33.081883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.083457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:33.089001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9abeca-1f1b-46be-9948-fe3587c67694 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.200489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.202216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.202690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.203167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.204079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.207476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.213627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81889e-acc9-4ca8-ac4f-4fe5d4ed211d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.233445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.234198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.234476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.234750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.236234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.238296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.260563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 874/1744] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:32 2021] POST /identity/v3/projects => generated 357 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:33.263457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.265816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 871/1745] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:33 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:33.266677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.268420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:33.272699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:33.288011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a25e2-7e47-4fbf-8058-3ef70a4b9541 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.367003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f839e9-7c3b-4a1b-abc1-e6c89dd91505 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.373385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.374249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.374534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.374961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.375801 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.377663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.384388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.385470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.385852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.386254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] PATH_INFO: `/v3/users/493e32ab548942b199fe343475539611` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.389292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493e32ab548942b199fe343475539611)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.391563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.407507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 875/1746] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:33 2021] POST /identity/v3/users => generated 301 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:33.409024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.412017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:33.431486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df02402-4419-4f3a-a5c5-aa8e41e85dc5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.447360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.448830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.449733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.450166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.450566 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493e32ab548942b199fe343475539611'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.451322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.454428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.470229 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493e32ab548942b199fe343475539611'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.478657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493e32ab548942b199fe343475539611'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.479608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493e32ab548942b199fe343475539611'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.488608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 876/1747] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:33 2021] POST /identity/v3/users => generated 285 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:33.489629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.491372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:33.500800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493e32ab548942b199fe343475539611'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:33.505608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eb82-acbc-4eec-a894-a837eea4fbbe admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.509327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 872/1748] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:33 2021] DELETE /identity/v3/users/493e32ab548942b199fe343475539611 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:33.510251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.512206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:33.516365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.516944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.517512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.517892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] PATH_INFO: `/v3/projects/267ad7ddf27d47baa2ee1feae42b4751/users/dd1ae29536ae4164a6157e5c65d5d966/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.520304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=267ad7ddf27d47baa2ee1feae42b4751, user_id=dd1ae29536ae4164a6157e5c65d5d966, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.523167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.547340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 877/1749] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:33 2021] PUT /identity/v3/projects/267ad7ddf27d47baa2ee1feae42b4751/users/dd1ae29536ae4164a6157e5c65d5d966/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:33.547340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.547340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:33.624777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adbb8f-68c5-46bc-92a8-f62e3c30d47f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.628640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484502ab-82ee-4fe7-a5ab-7c6a393d9f54 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.629865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e41c0-a74a-4097-a38f-2473e0cd4dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.630770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e41c0-a74a-4097-a38f-2473e0cd4dde admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.631267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e41c0-a74a-4097-a38f-2473e0cd4dde admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.631609 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e41c0-a74a-4097-a38f-2473e0cd4dde admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.632433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e41c0-a74a-4097-a38f-2473e0cd4dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.634139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e41c0-a74a-4097-a38f-2473e0cd4dde admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.637682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f62ca-f05f-476e-93d7-74e5ebee4d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.638466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f62ca-f05f-476e-93d7-74e5ebee4d1a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.638819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f62ca-f05f-476e-93d7-74e5ebee4d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.639164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f62ca-f05f-476e-93d7-74e5ebee4d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.640004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f62ca-f05f-476e-93d7-74e5ebee4d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.642658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f62ca-f05f-476e-93d7-74e5ebee4d1a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.652119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 878/1750] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:33 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:33.654043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848186f4-ab7e-4ec0-aa77-070d185f4fd1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.654328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848186f4-ab7e-4ec0-aa77-070d185f4fd1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.654960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848186f4-ab7e-4ec0-aa77-070d185f4fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.673664 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 873/1751] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:33 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:33.674922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f62ca-f05f-476e-93d7-74e5ebee4d1a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.691498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-848186f4-ab7e-4ec0-aa77-070d185f4fd1 None None] MFA Rules not processed for user `dd1ae29536ae4164a6157e5c65d5d966`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:33.692871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-848186f4-ab7e-4ec0-aa77-070d185f4fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:33.700450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f62ca-f05f-476e-93d7-74e5ebee4d1a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.721437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50588a6-d688-416a-b8ce-5f1247297655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.722769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50588a6-d688-416a-b8ce-5f1247297655 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.723649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50588a6-d688-416a-b8ce-5f1247297655 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.724175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50588a6-d688-416a-b8ce-5f1247297655 admin admin] PATH_INFO: `/v3/projects/f93d5f01d8d74a978515f1f56b98be4d/users/dbc0d79ec29a4ae28eeb61b0c38fb5f3/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.761018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50588a6-d688-416a-b8ce-5f1247297655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93d5f01d8d74a978515f1f56b98be4d, user_id=dbc0d79ec29a4ae28eeb61b0c38fb5f3, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.769050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50588a6-d688-416a-b8ce-5f1247297655 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:33.800811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 874/1752] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:33 2021] PUT /identity/v3/projects/f93d5f01d8d74a978515f1f56b98be4d/users/dbc0d79ec29a4ae28eeb61b0c38fb5f3/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:33.800811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50588a6-d688-416a-b8ce-5f1247297655 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.837743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 879/1753] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:33 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:33.839238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848186f4-ab7e-4ec0-aa77-070d185f4fd1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:33.865559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848186f4-ab7e-4ec0-aa77-070d185f4fd1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.931561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50588a6-d688-416a-b8ce-5f1247297655 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:33.949066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce4334-14ef-4e95-bd29-604fd28262bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.950310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4334-14ef-4e95-bd29-604fd28262bd admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.952503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4334-14ef-4e95-bd29-604fd28262bd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.953432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4334-14ef-4e95-bd29-604fd28262bd admin admin] PATH_INFO: `/v3/projects/5bd8e93687564f13b711e7e23e63333a/users/2374263141114ead85797fb1044c20d5/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.990067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:33.990581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:33.990873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:33.991151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:33.993147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:33.996493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.008228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce4334-14ef-4e95-bd29-604fd28262bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd8e93687564f13b711e7e23e63333a, user_id=2374263141114ead85797fb1044c20d5, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:34.010794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 880/1754] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:33 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:34.012383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:34.012724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce4334-14ef-4e95-bd29-604fd28262bd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.014003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:34.038564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 875/1755] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:33 2021] PUT /identity/v3/projects/5bd8e93687564f13b711e7e23e63333a/users/2374263141114ead85797fb1044c20d5/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:34.039987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce4334-14ef-4e95-bd29-604fd28262bd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:34.076694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3eb24-c638-408a-8808-3427300365c8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:34.130560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce4334-14ef-4e95-bd29-604fd28262bd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:34.136985 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537763ce-f587-4df2-b6cb-aee460a280a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:34.147961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe5c70-bf4f-4425-b6db-8363e1503a31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:34.148629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5c70-bf4f-4425-b6db-8363e1503a31 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.148910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5c70-bf4f-4425-b6db-8363e1503a31 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.149188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5c70-bf4f-4425-b6db-8363e1503a31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.152252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537763ce-f587-4df2-b6cb-aee460a280a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.154471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537763ce-f587-4df2-b6cb-aee460a280a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.154935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537763ce-f587-4df2-b6cb-aee460a280a1 admin admin] PATH_INFO: `/v3/projects/f93d5f01d8d74a978515f1f56b98be4d/users/dbc0d79ec29a4ae28eeb61b0c38fb5f3/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.159010 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537763ce-f587-4df2-b6cb-aee460a280a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93d5f01d8d74a978515f1f56b98be4d, user_id=dbc0d79ec29a4ae28eeb61b0c38fb5f3, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:34.169038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537763ce-f587-4df2-b6cb-aee460a280a1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.203953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 876/1756] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:34 2021] PUT /identity/v3/projects/f93d5f01d8d74a978515f1f56b98be4d/users/dbc0d79ec29a4ae28eeb61b0c38fb5f3/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:34.205158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537763ce-f587-4df2-b6cb-aee460a280a1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:34.216524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5c70-bf4f-4425-b6db-8363e1503a31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:34.217997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5c70-bf4f-4425-b6db-8363e1503a31 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.228920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 881/1757] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:34 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:34.230800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e1d2-e6f2-4eac-845a-5a47c4455355 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.231092 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e1d2-e6f2-4eac-845a-5a47c4455355 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.231377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e1d2-e6f2-4eac-845a-5a47c4455355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.261197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a875e1d2-e6f2-4eac-845a-5a47c4455355 None None] MFA Rules not processed for user `dbc0d79ec29a4ae28eeb61b0c38fb5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:34.263207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a875e1d2-e6f2-4eac-845a-5a47c4455355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:34.305250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537763ce-f587-4df2-b6cb-aee460a280a1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:34.316361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554cff8-f0ba-45dd-9ada-1a1c2bc32a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:34.317281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554cff8-f0ba-45dd-9ada-1a1c2bc32a17 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.317449 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554cff8-f0ba-45dd-9ada-1a1c2bc32a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.317738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554cff8-f0ba-45dd-9ada-1a1c2bc32a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.319881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554cff8-f0ba-45dd-9ada-1a1c2bc32a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:34.326293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554cff8-f0ba-45dd-9ada-1a1c2bc32a17 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.335165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 882/1758] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:34 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:34.369519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 877/1759] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:34 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:34.371046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e1d2-e6f2-4eac-845a-5a47c4455355 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:34.374092 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a875e1d2-e6f2-4eac-845a-5a47c4455355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:34.375412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554cff8-f0ba-45dd-9ada-1a1c2bc32a17 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:34.401792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554cff8-f0ba-45dd-9ada-1a1c2bc32a17 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:34.418178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b4fc3-4ef3-45c0-be15-58c78ef138eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:34.422355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b4fc3-4ef3-45c0-be15-58c78ef138eb admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.422795 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b4fc3-4ef3-45c0-be15-58c78ef138eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.423226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b4fc3-4ef3-45c0-be15-58c78ef138eb admin admin] PATH_INFO: `/v3/projects/5bd8e93687564f13b711e7e23e63333a/users/2374263141114ead85797fb1044c20d5/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.429291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b4fc3-4ef3-45c0-be15-58c78ef138eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd8e93687564f13b711e7e23e63333a, user_id=2374263141114ead85797fb1044c20d5, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:34.436733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b4fc3-4ef3-45c0-be15-58c78ef138eb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.456378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 878/1760] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:34 2021] PUT /identity/v3/projects/5bd8e93687564f13b711e7e23e63333a/users/2374263141114ead85797fb1044c20d5/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:34.470351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff3ee-35d3-4dcf-b082-cc5e1dd8255a None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.470672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff3ee-35d3-4dcf-b082-cc5e1dd8255a None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.470918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff3ee-35d3-4dcf-b082-cc5e1dd8255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.513819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-306ff3ee-35d3-4dcf-b082-cc5e1dd8255a None None] MFA Rules not processed for user `2374263141114ead85797fb1044c20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:34.517083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-306ff3ee-35d3-4dcf-b082-cc5e1dd8255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:34.517879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e1d2-e6f2-4eac-845a-5a47c4455355 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:34.658711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 879/1761] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:34 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:34.660622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54882da-68e5-46e6-96d1-4eb98ab4aaed None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.661085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54882da-68e5-46e6-96d1-4eb98ab4aaed None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.661202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba013f-d421-40d7-9101-292f0eb5187a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:34.661680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54882da-68e5-46e6-96d1-4eb98ab4aaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.662049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba013f-d421-40d7-9101-292f0eb5187a service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.662435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba013f-d421-40d7-9101-292f0eb5187a service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.662958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba013f-d421-40d7-9101-292f0eb5187a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.689291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-e54882da-68e5-46e6-96d1-4eb98ab4aaed None None] MFA Rules not processed for user `fd82b48aabbb419cb891867d0b1a57e0`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:34.690799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e54882da-68e5-46e6-96d1-4eb98ab4aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:34.765722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 880/1762] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:34 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:34.765722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54882da-68e5-46e6-96d1-4eb98ab4aaed None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:34.769859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e54882da-68e5-46e6-96d1-4eb98ab4aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:34.792242 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba013f-d421-40d7-9101-292f0eb5187a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:34.794373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba013f-d421-40d7-9101-292f0eb5187a service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.816501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 883/1763] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:34 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:34.817461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba013f-d421-40d7-9101-292f0eb5187a service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:34.832140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba013f-d421-40d7-9101-292f0eb5187a service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:34.850574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d15b-98ac-421d-9d59-8be1148d37f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:34.851797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d15b-98ac-421d-9d59-8be1148d37f4 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.852227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d15b-98ac-421d-9d59-8be1148d37f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.852651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d15b-98ac-421d-9d59-8be1148d37f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.870802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d15b-98ac-421d-9d59-8be1148d37f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:34.872920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d15b-98ac-421d-9d59-8be1148d37f4 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.883128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 884/1764] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:34 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:34.884805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54882da-68e5-46e6-96d1-4eb98ab4aaed None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:34.891053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:34.891993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:34.892281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:34.892627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] PATH_INFO: `/v3/projects/60a8bb3f862d4060912f97f555c82f89` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:34.893828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a8bb3f862d4060912f97f555c82f89)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:34.895948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:34.959566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d15b-98ac-421d-9d59-8be1148d37f4 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:34.970507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d15b-98ac-421d-9d59-8be1148d37f4 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:34.971196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a8bb3f862d4060912f97f555c82f89', 'request_id': 'req-3f2262af-d74a-4865-b6d0-35a4b3991bc9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:34.978885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a8bb3f862d4060912f97f555c82f89', 'request_id': 'req-3f2262af-d74a-4865-b6d0-35a4b3991bc9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:34.994084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a8bb3f862d4060912f97f555c82f89', 'request_id': 'req-3f2262af-d74a-4865-b6d0-35a4b3991bc9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.007139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] The token cache is being invalidate because project 60a8bb3f862d4060912f97f555c82f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:35.007753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.016543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.033952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 881/1765] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:34 2021] DELETE /identity/v3/projects/60a8bb3f862d4060912f97f555c82f89 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:35.037801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:35.039157 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:35.040079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad01cd6-bec7-4022-abd3-2e5f0a4fa2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:35.040982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad01cd6-bec7-4022-abd3-2e5f0a4fa2de service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:35.041486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad01cd6-bec7-4022-abd3-2e5f0a4fa2de service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:35.042152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad01cd6-bec7-4022-abd3-2e5f0a4fa2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:35.045059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3ad01cd6-bec7-4022-abd3-2e5f0a4fa2de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:35.116594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad01cd6-bec7-4022-abd3-2e5f0a4fa2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:35.118168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad01cd6-bec7-4022-abd3-2e5f0a4fa2de service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:35.130387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2262af-d74a-4865-b6d0-35a4b3991bc9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:35.136299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:35.137563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:35.137805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:35.138145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] PATH_INFO: `/v3/users/c6b497033257447bbefafac0584bcb88` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:35.139592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b497033257447bbefafac0584bcb88)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:35.141736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:35.151405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 885/1766] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:34 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:35.189332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced80f-0a14-4bd6-86d2-e5d5a6a1addf None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:35.189655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced80f-0a14-4bd6-86d2-e5d5a6a1addf None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:35.189938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced80f-0a14-4bd6-86d2-e5d5a6a1addf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:35.210053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9dced80f-0a14-4bd6-86d2-e5d5a6a1addf None None] MFA Rules not processed for user `faf7da464d4c44db918dd6c5076846e9`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:35.211952 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9dced80f-0a14-4bd6-86d2-e5d5a6a1addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:35.229779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b497033257447bbefafac0584bcb88'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.258805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b497033257447bbefafac0584bcb88'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.268722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b497033257447bbefafac0584bcb88'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.269482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b497033257447bbefafac0584bcb88'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.280310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b497033257447bbefafac0584bcb88'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.288624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 882/1767] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:35 2021] DELETE /identity/v3/users/c6b497033257447bbefafac0584bcb88 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:35.289420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:35.290843 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:35.303232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 886/1768] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:35 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:35.456580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e64d3-5fc3-4732-8656-208024d9c19b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:35.463641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:35.465396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:35.466032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:35.466426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] PATH_INFO: `/v3/users/67c19fd11ced473fa0f66e8de642fb51` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:35.468202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c19fd11ced473fa0f66e8de642fb51)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:35.470756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:35.540667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c19fd11ced473fa0f66e8de642fb51'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.556638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c19fd11ced473fa0f66e8de642fb51'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.586941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c19fd11ced473fa0f66e8de642fb51'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.588044 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c19fd11ced473fa0f66e8de642fb51'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.599271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c19fd11ced473fa0f66e8de642fb51'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:35.607358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 883/1769] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:35 2021] DELETE /identity/v3/users/67c19fd11ced473fa0f66e8de642fb51 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:35.612147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14f40-bec1-4076-9576-28851df65421 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:35.612147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14f40-bec1-4076-9576-28851df65421 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:35.612464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14f40-bec1-4076-9576-28851df65421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:35.634983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9bf14f40-bec1-4076-9576-28851df65421 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:35.636323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9bf14f40-bec1-4076-9576-28851df65421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:35.722396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 887/1770] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:35.733703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:35.735326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:35.911030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b34c9-ce24-4792-9821-508ae9c0e4b7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:35.917196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6f5f-f952-4ae5-a5e7-41a70db8acc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:35.919216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6f5f-f952-4ae5-a5e7-41a70db8acc6 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:35.919690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6f5f-f952-4ae5-a5e7-41a70db8acc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:35.920111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6f5f-f952-4ae5-a5e7-41a70db8acc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:35.957134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6f5f-f952-4ae5-a5e7-41a70db8acc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:35.964288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6f5f-f952-4ae5-a5e7-41a70db8acc6 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:35.990793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 884/1771] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:36.030861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14f40-bec1-4076-9576-28851df65421 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:36.032400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9bf14f40-bec1-4076-9576-28851df65421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:36.052902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14f40-bec1-4076-9576-28851df65421 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:36.066222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:36.067131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:36.067420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:36.067750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] PATH_INFO: `/v3/projects/a77daa82e71b4a0086a5a796c7f3f559` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:36.069430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77daa82e71b4a0086a5a796c7f3f559)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:36.073003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:36.155196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77daa82e71b4a0086a5a796c7f3f559', 'request_id': 'req-25e667bf-c1a6-4ade-bc00-b30c20e524b0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:36.170379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77daa82e71b4a0086a5a796c7f3f559', 'request_id': 'req-25e667bf-c1a6-4ade-bc00-b30c20e524b0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:36.192978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77daa82e71b4a0086a5a796c7f3f559', 'request_id': 'req-25e667bf-c1a6-4ade-bc00-b30c20e524b0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:36.220181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] The token cache is being invalidate because project a77daa82e71b4a0086a5a796c7f3f559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:36.220469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:36.222553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-25e667bf-c1a6-4ade-bc00-b30c20e524b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:36.227410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 888/1772] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:36 2021] DELETE /identity/v3/projects/a77daa82e71b4a0086a5a796c7f3f559 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:36.234650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ee757-a518-4d9a-9113-70b04ef4fc40 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:36.234943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ee757-a518-4d9a-9113-70b04ef4fc40 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:36.235222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ee757-a518-4d9a-9113-70b04ef4fc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:36.272723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c10ee757-a518-4d9a-9113-70b04ef4fc40 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:36.273926 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c10ee757-a518-4d9a-9113-70b04ef4fc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:36.430385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dfc8-c86f-490e-a66b-3fe4b937a07f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:36.430971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dfc8-c86f-490e-a66b-3fe4b937a07f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:36.430971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dfc8-c86f-490e-a66b-3fe4b937a07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:36.437896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 885/1773] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:36.463800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ff16dfc8-c86f-490e-a66b-3fe4b937a07f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:36.465644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ff16dfc8-c86f-490e-a66b-3fe4b937a07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:36.502667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 889/1774] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:36.506692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ee757-a518-4d9a-9113-70b04ef4fc40 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:36.518264 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ee757-a518-4d9a-9113-70b04ef4fc40 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:36.524250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:36.524930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:36.525210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:36.525489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:36.526663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:36.527847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:36.529764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:36.549873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 886/1775] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:36.550743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16dfc8-c86f-490e-a66b-3fe4b937a07f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:36.564684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16dfc8-c86f-490e-a66b-3fe4b937a07f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:36.579424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:36.580131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:36.580414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:36.580692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:36.581444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:36.583440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:36.649538 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 890/1776] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:36 2021] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:36.651905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:36.668920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62796aa-4a2a-42d1-ae2a-ffa44ecddd8d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:36.820354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8485b-d142-4a49-bb65-2f060e34a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:36.821463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8485b-d142-4a49-bb65-2f060e34a19b admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:36.821463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8485b-d142-4a49-bb65-2f060e34a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:36.821692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8485b-d142-4a49-bb65-2f060e34a19b admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:36.822380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8485b-d142-4a49-bb65-2f060e34a19b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:36.835076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8485b-d142-4a49-bb65-2f060e34a19b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:36.887896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:36.890060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:36.900268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 887/1777] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:36 2021] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:36.901466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8485b-d142-4a49-bb65-2f060e34a19b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:36.916280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2bd6e-88e0-404c-b092-7a3cd38fe9d4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:36.929542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:36.930558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:36.930942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:36.931473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] PATH_INFO: `/v3/users/5bba0914e8694fe9a92a6b775424f8c6` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:36.932839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bba0914e8694fe9a92a6b775424f8c6)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:36.937497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:36.947972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8485b-d142-4a49-bb65-2f060e34a19b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:36.963320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:36.964339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:36.965232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:36.965516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:36.966359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:36.969180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:36.997332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 888/1778] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:36 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:36.998212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:37.000553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.026754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9dada-ea6b-4c31-a2d9-e3c607c422ef admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:37.046659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:37.048341 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.049298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.049810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] PATH_INFO: `/v3/projects/869e0ee2e07646ea9d6eb4993c675d9e` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.051510 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869e0ee2e07646ea9d6eb4993c675d9e)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:37.052216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bba0914e8694fe9a92a6b775424f8c6'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.055856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:37.076477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bba0914e8694fe9a92a6b775424f8c6'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.077536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bba0914e8694fe9a92a6b775424f8c6'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.092719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bba0914e8694fe9a92a6b775424f8c6'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.094187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bba0914e8694fe9a92a6b775424f8c6'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.131248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869e0ee2e07646ea9d6eb4993c675d9e', 'request_id': 'req-31017d8e-c418-4926-8fb1-2cb8ae058a44'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.140894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869e0ee2e07646ea9d6eb4993c675d9e', 'request_id': 'req-31017d8e-c418-4926-8fb1-2cb8ae058a44'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.148369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 891/1779] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:36 2021] DELETE /identity/v3/users/5bba0914e8694fe9a92a6b775424f8c6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:37.149919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:37.156812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.169005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869e0ee2e07646ea9d6eb4993c675d9e', 'request_id': 'req-31017d8e-c418-4926-8fb1-2cb8ae058a44'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.185235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] The token cache is being invalidate because project 869e0ee2e07646ea9d6eb4993c675d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:37.185811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.186695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-31017d8e-c418-4926-8fb1-2cb8ae058a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.188534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 889/1780] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:36 2021] DELETE /identity/v3/projects/869e0ee2e07646ea9d6eb4993c675d9e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:37.190625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a73b-56e4-4435-bd7e-cfb36ea2af10 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.192062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a73b-56e4-4435-bd7e-cfb36ea2af10 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.192590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a73b-56e4-4435-bd7e-cfb36ea2af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.216993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d493a73b-56e4-4435-bd7e-cfb36ea2af10 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:37.218158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d493a73b-56e4-4435-bd7e-cfb36ea2af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.243532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5737-ae76-40ce-82a7-f24f3b2960c4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:37.250699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:37.251455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.251946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.252665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.253850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:37.255754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:37.272773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 892/1781] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:37 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:37.278313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:37.280793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.291142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 890/1782] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:37.296882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493a73b-56e4-4435-bd7e-cfb36ea2af10 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:37.297639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0940-b45f-44a2-970a-2642626f4101 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:37.299798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d493a73b-56e4-4435-bd7e-cfb36ea2af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.302655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:37.303634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.304027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.304834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] PATH_INFO: `/v3/users/2374263141114ead85797fb1044c20d5` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.306310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2374263141114ead85797fb1044c20d5)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:37.309398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:37.315106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493a73b-56e4-4435-bd7e-cfb36ea2af10 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:37.321474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:37.322822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.323205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.323493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] PATH_INFO: `/v3/projects/31932750db0d46cd99171ebc0feef6a3/users/9de307be39ad4d55b070560307a8de3d/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.345741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31932750db0d46cd99171ebc0feef6a3, user_id=9de307be39ad4d55b070560307a8de3d, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:37.349472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:37.370446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 891/1783] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:37 2021] PUT /identity/v3/projects/31932750db0d46cd99171ebc0feef6a3/users/9de307be39ad4d55b070560307a8de3d/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:37.372046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2374263141114ead85797fb1044c20d5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.372810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:37.375345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.388828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2374263141114ead85797fb1044c20d5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.389865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2374263141114ead85797fb1044c20d5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.399372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2374263141114ead85797fb1044c20d5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.400075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0efc7be6-cf11-43a4-b6c8-511fa247637b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2374263141114ead85797fb1044c20d5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:37.413088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 893/1784] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:37 2021] DELETE /identity/v3/users/2374263141114ead85797fb1044c20d5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:37.414404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1014-5514-4206-a3a2-9d58de0dc7df None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.414689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1014-5514-4206-a3a2-9d58de0dc7df None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.414963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1014-5514-4206-a3a2-9d58de0dc7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.447077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512287-1da0-440f-83a5-b315e3a0c9e2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:37.455528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fd5a1014-5514-4206-a3a2-9d58de0dc7df None None] MFA Rules not processed for user `9de307be39ad4d55b070560307a8de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:37.457288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fd5a1014-5514-4206-a3a2-9d58de0dc7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.536051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:37.537357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.537821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.538268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.540333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.595187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 894/1785] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:37 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:37.599943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1014-5514-4206-a3a2-9d58de0dc7df None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:37.601581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fd5a1014-5514-4206-a3a2-9d58de0dc7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.653999 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:37.656001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:37.670385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 892/1786] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:37.734432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1014-5514-4206-a3a2-9d58de0dc7df None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:37.740649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:37.741377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.741659 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.742082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.743288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:37.746751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:37.788636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 895/1787] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:37 2021] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:37.789552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:37.801099 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf92f7-d14c-4625-9f42-82c69cbb6848 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:37.889850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:37.891581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:37.989696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f449b-7a8f-4f8e-9fc3-432295877722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:37.990397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f449b-7a8f-4f8e-9fc3-432295877722 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:37.990690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f449b-7a8f-4f8e-9fc3-432295877722 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:37.990985 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f449b-7a8f-4f8e-9fc3-432295877722 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:37.991691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f449b-7a8f-4f8e-9fc3-432295877722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:37.993735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f449b-7a8f-4f8e-9fc3-432295877722 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.002089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b2b6-e9c1-4d1f-af0f-56fa77ee219e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.009787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.013643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.014135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.014506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] PATH_INFO: `/v3/projects/5bd8e93687564f13b711e7e23e63333a` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.016350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd8e93687564f13b711e7e23e63333a)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.017993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.025880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 893/1788] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:37 2021] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:38.029770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f449b-7a8f-4f8e-9fc3-432295877722 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.043972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f449b-7a8f-4f8e-9fc3-432295877722 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.055701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf2a7c-56ea-4da1-8036-dc2d7ab2719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.057292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf2a7c-56ea-4da1-8036-dc2d7ab2719f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.057655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf2a7c-56ea-4da1-8036-dc2d7ab2719f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.058048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf2a7c-56ea-4da1-8036-dc2d7ab2719f admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.059943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf2a7c-56ea-4da1-8036-dc2d7ab2719f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.062813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf2a7c-56ea-4da1-8036-dc2d7ab2719f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.077616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 894/1789] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:38 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:38.082508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf2a7c-56ea-4da1-8036-dc2d7ab2719f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.099519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf2a7c-56ea-4da1-8036-dc2d7ab2719f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.111332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd8e93687564f13b711e7e23e63333a', 'request_id': 'req-d24a68da-b185-4cbd-990d-d9aa30d24ac5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.118479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd8e93687564f13b711e7e23e63333a', 'request_id': 'req-d24a68da-b185-4cbd-990d-d9aa30d24ac5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.136768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd8e93687564f13b711e7e23e63333a', 'request_id': 'req-d24a68da-b185-4cbd-990d-d9aa30d24ac5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.179820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] The token cache is being invalidate because project 5bd8e93687564f13b711e7e23e63333a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:38.180117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.182617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d24a68da-b185-4cbd-990d-d9aa30d24ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.194821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 896/1790] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:37 2021] DELETE /identity/v3/projects/5bd8e93687564f13b711e7e23e63333a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:38.197148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4f63-0902-4c59-994b-1f4e6e26be74 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.197444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4f63-0902-4c59-994b-1f4e6e26be74 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.197735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4f63-0902-4c59-994b-1f4e6e26be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.198013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.198966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.199256 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.199536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] PATH_INFO: `/v3/projects/5bb37105ed9b4d48af587e35ce9c79ef/users/49f76f3f044f4f09881d5f9066dad878/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.233665 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb37105ed9b4d48af587e35ce9c79ef, user_id=49f76f3f044f4f09881d5f9066dad878, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.237184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.240628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-32bb4f63-0902-4c59-994b-1f4e6e26be74 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:38.241836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-32bb4f63-0902-4c59-994b-1f4e6e26be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:38.254355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 897/1791] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:38.262590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a95c2-ffc5-46fa-b1f8-8f7d81bf2021 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.263304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 895/1792] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:38 2021] PUT /identity/v3/projects/5bb37105ed9b4d48af587e35ce9c79ef/users/49f76f3f044f4f09881d5f9066dad878/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:38.263929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a95c2-ffc5-46fa-b1f8-8f7d81bf2021 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.264391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a95c2-ffc5-46fa-b1f8-8f7d81bf2021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.267016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.270105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:38.290340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ef5a95c2-ffc5-46fa-b1f8-8f7d81bf2021 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:38.291963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ef5a95c2-ffc5-46fa-b1f8-8f7d81bf2021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:38.363870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 898/1793] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:38.366728 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a95c2-ffc5-46fa-b1f8-8f7d81bf2021 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.378830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a95c2-ffc5-46fa-b1f8-8f7d81bf2021 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.393184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.396417 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.397695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.399523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.409406 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:38.409740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.411269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ff7c1-598c-4fb0-ba8f-c9b9360691e6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.413539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.420278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27948a90-d212-4420-a8af-7a6c572846cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.421400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27948a90-d212-4420-a8af-7a6c572846cd admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.421835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27948a90-d212-4420-a8af-7a6c572846cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.422261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27948a90-d212-4420-a8af-7a6c572846cd admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.423233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27948a90-d212-4420-a8af-7a6c572846cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.426417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27948a90-d212-4420-a8af-7a6c572846cd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.438743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 899/1794] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:38.439474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.458622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9be1-0ab6-4c60-8214-0f503f97345c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.461872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 896/1795] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:38 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:38.466979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27948a90-d212-4420-a8af-7a6c572846cd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.483509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.484916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.485423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.486013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.487486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.488904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27948a90-d212-4420-a8af-7a6c572846cd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.490395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.503269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f4c9-3dbb-4e0c-bcb7-0ba4c5e804ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.507039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f4c9-3dbb-4e0c-bcb7-0ba4c5e804ac admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.508183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f4c9-3dbb-4e0c-bcb7-0ba4c5e804ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.508640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f4c9-3dbb-4e0c-bcb7-0ba4c5e804ac admin admin] PATH_INFO: `/v3/projects/5bb37105ed9b4d48af587e35ce9c79ef/users/49f76f3f044f4f09881d5f9066dad878/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.516168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8f4c9-3dbb-4e0c-bcb7-0ba4c5e804ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb37105ed9b4d48af587e35ce9c79ef, user_id=49f76f3f044f4f09881d5f9066dad878, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.523527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8f4c9-3dbb-4e0c-bcb7-0ba4c5e804ac admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.544020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 900/1796] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:38 2021] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:38.545579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.549127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:38.557899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 897/1797] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:38 2021] PUT /identity/v3/projects/5bb37105ed9b4d48af587e35ce9c79ef/users/49f76f3f044f4f09881d5f9066dad878/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:38.558720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f4c9-3dbb-4e0c-bcb7-0ba4c5e804ac admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.674162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d911803-87c4-44e9-9b5c-bf8c2ed968b1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.683881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f4c9-3dbb-4e0c-bcb7-0ba4c5e804ac admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:38.685529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.687664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.689124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.689798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] PATH_INFO: `/v3/projects/cc5dda143d454349b51b81f6861ec5fb` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.692536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5dda143d454349b51b81f6861ec5fb)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.693822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6212-1c28-4b7a-8ca1-8868c2aa9534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:38.694816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6212-1c28-4b7a-8ca1-8868c2aa9534 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.695631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6212-1c28-4b7a-8ca1-8868c2aa9534 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.696207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6212-1c28-4b7a-8ca1-8868c2aa9534 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.697868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb6212-1c28-4b7a-8ca1-8868c2aa9534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:38.698612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.701880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb6212-1c28-4b7a-8ca1-8868c2aa9534 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:38.747053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 898/1798] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:38 2021] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:38.747053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae3e55-4f57-46be-ab23-8250626c58a1 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:38.747053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae3e55-4f57-46be-ab23-8250626c58a1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:38.747053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae3e55-4f57-46be-ab23-8250626c58a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:38.810137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-cfae3e55-4f57-46be-ab23-8250626c58a1 None None] MFA Rules not processed for user `49f76f3f044f4f09881d5f9066dad878`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:38.812079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cfae3e55-4f57-46be-ab23-8250626c58a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:38.830623 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5dda143d454349b51b81f6861ec5fb', 'request_id': 'req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.849990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5dda143d454349b51b81f6861ec5fb', 'request_id': 'req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.868734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5dda143d454349b51b81f6861ec5fb', 'request_id': 'req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.887909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] The token cache is being invalidate because project cc5dda143d454349b51b81f6861ec5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:38.888872 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.890436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:38.895093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 901/1799] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:38 2021] DELETE /identity/v3/projects/cc5dda143d454349b51b81f6861ec5fb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:38.896791 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.902563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:38.969948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 899/1800] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:38 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:38.971084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae3e55-4f57-46be-ab23-8250626c58a1 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:38.973132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cfae3e55-4f57-46be-ab23-8250626c58a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:39.006202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e2bc-8f8d-4208-b0d8-7a16fc3c5a3e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:39.013564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:39.014782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.015639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.016611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.018124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:39.021380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:39.040547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 902/1801] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:38 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:39.042423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:39.046273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:39.059687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae3e55-4f57-46be-ab23-8250626c58a1 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:39.065131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:39.066027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.066305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.066581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] PATH_INFO: `/v3/users/dd1ae29536ae4164a6157e5c65d5d966` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.067949 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1ae29536ae4164a6157e5c65d5d966)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:39.070512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:39.127375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae8c5-cc20-4319-9dd7-29764a51630a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:39.132299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd28919-175b-4862-9081-1837037084e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:39.133302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28919-175b-4862-9081-1837037084e3 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.133593 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28919-175b-4862-9081-1837037084e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.134719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28919-175b-4862-9081-1837037084e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.151691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd28919-175b-4862-9081-1837037084e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:39.154473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd28919-175b-4862-9081-1837037084e3 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:39.172722 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 903/1802] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:39 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:39.174592 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd28919-175b-4862-9081-1837037084e3 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:39.175457 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1ae29536ae4164a6157e5c65d5d966'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:39.201235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1ae29536ae4164a6157e5c65d5d966'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:39.209140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd28919-175b-4862-9081-1837037084e3 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:39.212962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1ae29536ae4164a6157e5c65d5d966'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:39.215208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1ae29536ae4164a6157e5c65d5d966'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:39.224513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:39.226478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1ae29536ae4164a6157e5c65d5d966'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:39.227320 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.227834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.229475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.231025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:39.233680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:39.242986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 900/1803] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:38 2021] DELETE /identity/v3/users/dd1ae29536ae4164a6157e5c65d5d966 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:39.249113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 904/1804] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:39 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:39.253019 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:39.255138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:39.262002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:39.282821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:39.298033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932873-bb03-4afe-b1b2-e915452bcb53 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:39.344757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2309f-035c-4fdb-ada8-8cd70d990f46 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:39.350570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6980e-a3f1-4ff7-aa8d-cd4f5a170e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:39.352293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6980e-a3f1-4ff7-aa8d-cd4f5a170e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.352807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6980e-a3f1-4ff7-aa8d-cd4f5a170e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.353288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6980e-a3f1-4ff7-aa8d-cd4f5a170e66 admin admin] PATH_INFO: `/v3/projects/33683b89aaef454ab4713330fa6a4e61/users/0b6802f5fc884bb5ad0494ebc2a58f2a/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.371734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:39.372078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6980e-a3f1-4ff7-aa8d-cd4f5a170e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33683b89aaef454ab4713330fa6a4e61, user_id=0b6802f5fc884bb5ad0494ebc2a58f2a, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:39.372554 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.372907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.373252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.375332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:39.389040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6980e-a3f1-4ff7-aa8d-cd4f5a170e66 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:39.407482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 901/1805] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:39 2021] PUT /identity/v3/projects/33683b89aaef454ab4713330fa6a4e61/users/0b6802f5fc884bb5ad0494ebc2a58f2a/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:39.418502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b0a2c-0641-4d87-aa14-aeef8039be85 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.418781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b0a2c-0641-4d87-aa14-aeef8039be85 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.419058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b0a2c-0641-4d87-aa14-aeef8039be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.449484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c93b0a2c-0641-4d87-aa14-aeef8039be85 None None] MFA Rules not processed for user `0b6802f5fc884bb5ad0494ebc2a58f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:39.451093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c93b0a2c-0641-4d87-aa14-aeef8039be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:39.464341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:39.466704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:39.478007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 905/1806] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:39 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:39.560661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 902/1807] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:39 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:39.577154 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:39.579953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:39.702214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b0a2c-0641-4d87-aa14-aeef8039be85 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:39.704226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c93b0a2c-0641-4d87-aa14-aeef8039be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:39.752278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471b51-491f-482b-85fa-3a6be4ef17f5 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:39.840576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b0a2c-0641-4d87-aa14-aeef8039be85 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:39.852231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:39.853386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.853836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.854121 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] PATH_INFO: `/v3/users/9de307be39ad4d55b070560307a8de3d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.864350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de307be39ad4d55b070560307a8de3d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:39.866959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:39.875591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc10755-1acf-4270-a93a-f3d746e649e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:39.876297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10755-1acf-4270-a93a-f3d746e649e3 service glance] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:39.876577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10755-1acf-4270-a93a-f3d746e649e3 service glance] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:39.877155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10755-1acf-4270-a93a-f3d746e649e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:39.897214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc10755-1acf-4270-a93a-f3d746e649e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:39.899742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc10755-1acf-4270-a93a-f3d746e649e3 service glance] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:39.921769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 906/1808] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:39 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:39.957522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de307be39ad4d55b070560307a8de3d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:39.977036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de307be39ad4d55b070560307a8de3d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:39.986897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de307be39ad4d55b070560307a8de3d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:39.988005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de307be39ad4d55b070560307a8de3d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:40.000761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bb4ad33-d8e4-4867-a94c-368edd34bb96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de307be39ad4d55b070560307a8de3d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:40.048126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 903/1809] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:39 2021] DELETE /identity/v3/users/9de307be39ad4d55b070560307a8de3d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:40.052634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a449b-b1af-4196-a491-54f589eed228 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:40.052927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a449b-b1af-4196-a491-54f589eed228 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:40.053215 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a449b-b1af-4196-a491-54f589eed228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:40.091043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ee5a449b-b1af-4196-a491-54f589eed228 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:40.092192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ee5a449b-b1af-4196-a491-54f589eed228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:40.136798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77520-4509-4865-a34d-69b06ba90787 None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:40.137183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77520-4509-4865-a34d-69b06ba90787 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:40.137814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77520-4509-4865-a34d-69b06ba90787 None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:40.140135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 904/1810] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:37:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:37:40.168721 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664644f-709d-4fe3-b571-20f3fed7539c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:40.169390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664644f-709d-4fe3-b571-20f3fed7539c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:40.169763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664644f-709d-4fe3-b571-20f3fed7539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:40.211205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6664644f-709d-4fe3-b571-20f3fed7539c None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:40.212991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6664644f-709d-4fe3-b571-20f3fed7539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:40.248362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 907/1811] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:40.285841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a449b-b1af-4196-a491-54f589eed228 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:40.290629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ee5a449b-b1af-4196-a491-54f589eed228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:40.440951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 905/1812] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:37:40 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:40.442214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664644f-709d-4fe3-b571-20f3fed7539c None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:40.444817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6664644f-709d-4fe3-b571-20f3fed7539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:40.481189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a449b-b1af-4196-a491-54f589eed228 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:40.482920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664644f-709d-4fe3-b571-20f3fed7539c None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:40.490902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf796-1bae-498e-865f-c97e610ab873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:40.491165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:40.491580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf796-1bae-498e-865f-c97e610ab873 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:40.492559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:40.493052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:40.493681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] PATH_INFO: `/v3/projects/267ad7ddf27d47baa2ee1feae42b4751` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:40.494696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf796-1bae-498e-865f-c97e610ab873 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:40.495007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf796-1bae-498e-865f-c97e610ab873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:40.495765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] RBAC: Authorizing `identity:delete_project(project_id=267ad7ddf27d47baa2ee1feae42b4751)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:40.498122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:40.521410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdf796-1bae-498e-865f-c97e610ab873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:40.524686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdf796-1bae-498e-865f-c97e610ab873 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:40.551136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 908/1813] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:40.623647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267ad7ddf27d47baa2ee1feae42b4751', 'request_id': 'req-96017a64-2694-475f-8911-f9e298e086be'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:40.635650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267ad7ddf27d47baa2ee1feae42b4751', 'request_id': 'req-96017a64-2694-475f-8911-f9e298e086be'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:40.657577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267ad7ddf27d47baa2ee1feae42b4751', 'request_id': 'req-96017a64-2694-475f-8911-f9e298e086be'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:40.694542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] The token cache is being invalidate because project 267ad7ddf27d47baa2ee1feae42b4751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:40.694542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:40.706467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-96017a64-2694-475f-8911-f9e298e086be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:40.706467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 906/1814] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:40 2021] DELETE /identity/v3/projects/267ad7ddf27d47baa2ee1feae42b4751 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:40.709278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a245-5efb-4d93-a22c-2f7c58beb543 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:40.709594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a245-5efb-4d93-a22c-2f7c58beb543 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:40.709895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a245-5efb-4d93-a22c-2f7c58beb543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:40.769040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6ed1a245-5efb-4d93-a22c-2f7c58beb543 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:40.770974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6ed1a245-5efb-4d93-a22c-2f7c58beb543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:40.940232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 909/1815] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:40.944568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1aa5b-fd88-4e23-933a-354b8bbb3b3f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:40.944855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1aa5b-fd88-4e23-933a-354b8bbb3b3f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:40.945127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1aa5b-fd88-4e23-933a-354b8bbb3b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:40.995442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-21b1aa5b-fd88-4e23-933a-354b8bbb3b3f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:41.010817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-21b1aa5b-fd88-4e23-933a-354b8bbb3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:41.036083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 907/1816] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:41.040064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1a245-5efb-4d93-a22c-2f7c58beb543 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:41.061541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1a245-5efb-4d93-a22c-2f7c58beb543 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:41.086694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:41.087673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:41.088043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:41.088325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:41.089284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:41.089529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:41.100630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:41.135583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 910/1817] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:37:41.141356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1aa5b-fd88-4e23-933a-354b8bbb3b3f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:41.153269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1aa5b-fd88-4e23-933a-354b8bbb3b3f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:41.158827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:41.160112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:41.160634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:41.160996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:41.162310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:41.164106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:41.210267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 908/1818] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:41 2021] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:41.215140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:41.233107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7967a-1051-44be-b14b-652db35cccd2 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:41.342256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb5e5b-16a8-4c64-acba-738ebda9cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:41.343118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb5e5b-16a8-4c64-acba-738ebda9cf6e admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:41.343577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb5e5b-16a8-4c64-acba-738ebda9cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:41.344278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb5e5b-16a8-4c64-acba-738ebda9cf6e admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:41.345318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb5e5b-16a8-4c64-acba-738ebda9cf6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:41.348644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb5e5b-16a8-4c64-acba-738ebda9cf6e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:41.349773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:41.352607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:41.385541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 911/1819] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:41 2021] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:41.394142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb5e5b-16a8-4c64-acba-738ebda9cf6e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:41.423935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb5e5b-16a8-4c64-acba-738ebda9cf6e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:41.432504 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b838eb6-ab41-43dc-8d4d-a86957fcb8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:41.434532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838eb6-ab41-43dc-8d4d-a86957fcb8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:41.434992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838eb6-ab41-43dc-8d4d-a86957fcb8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:41.436413 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838eb6-ab41-43dc-8d4d-a86957fcb8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:41.438875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b838eb6-ab41-43dc-8d4d-a86957fcb8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:41.441572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b838eb6-ab41-43dc-8d4d-a86957fcb8f0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:41.476876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 912/1820] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:41.478098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b838eb6-ab41-43dc-8d4d-a86957fcb8f0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:41.505034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b838eb6-ab41-43dc-8d4d-a86957fcb8f0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:41.522539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3a0a0-83fe-454b-bbf2-f944cc672624 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:41.525018 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78caff-cbc1-401c-b2ca-bf0deb031efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:41.525712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78caff-cbc1-401c-b2ca-bf0deb031efd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:41.525998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78caff-cbc1-401c-b2ca-bf0deb031efd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:41.526277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78caff-cbc1-401c-b2ca-bf0deb031efd admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:41.529527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab507e-402b-416d-9a76-6d86fadaec4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:41.530315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab507e-402b-416d-9a76-6d86fadaec4f service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:41.530676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab507e-402b-416d-9a76-6d86fadaec4f service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:41.530779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78caff-cbc1-401c-b2ca-bf0deb031efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:41.531067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab507e-402b-416d-9a76-6d86fadaec4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:41.532396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78caff-cbc1-401c-b2ca-bf0deb031efd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:41.533730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-42ab507e-402b-416d-9a76-6d86fadaec4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:41.548662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab507e-402b-416d-9a76-6d86fadaec4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:41.552826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab507e-402b-416d-9a76-6d86fadaec4f service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:41.569877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 913/1821] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:41.570428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78caff-cbc1-401c-b2ca-bf0deb031efd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:41.582960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 909/1822] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:41.610082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78caff-cbc1-401c-b2ca-bf0deb031efd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:41.628170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20b81c-296c-4b05-b4e3-909ad42378ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:41.628897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20b81c-296c-4b05-b4e3-909ad42378ad admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:41.629507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20b81c-296c-4b05-b4e3-909ad42378ad admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:41.629790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20b81c-296c-4b05-b4e3-909ad42378ad admin admin] PATH_INFO: `/v3/projects/1f9bfb64344f4e2789abb08b1be84a70/users/3de6dedbcece4b91ba92bd8768871ff7/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:41.660311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20b81c-296c-4b05-b4e3-909ad42378ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9bfb64344f4e2789abb08b1be84a70, user_id=3de6dedbcece4b91ba92bd8768871ff7, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:41.665661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20b81c-296c-4b05-b4e3-909ad42378ad admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:41.692896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 914/1823] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:41 2021] PUT /identity/v3/projects/1f9bfb64344f4e2789abb08b1be84a70/users/3de6dedbcece4b91ba92bd8768871ff7/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:41.705127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cb457-7e0b-4555-b16b-0fa8779c6c40 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:41.705640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cb457-7e0b-4555-b16b-0fa8779c6c40 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:41.705721 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cb457-7e0b-4555-b16b-0fa8779c6c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:41.781412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ad8cb457-7e0b-4555-b16b-0fa8779c6c40 None None] MFA Rules not processed for user `3de6dedbcece4b91ba92bd8768871ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:41.782651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ad8cb457-7e0b-4555-b16b-0fa8779c6c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:41.927805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 910/1824] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:41 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:41.932007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20b81c-296c-4b05-b4e3-909ad42378ad admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.042957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20b81c-296c-4b05-b4e3-909ad42378ad admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:42.049499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:42.050309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.050853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.051228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.052068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:42.055503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:42.120711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 915/1825] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:41 2021] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:42.124890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cb457-7e0b-4555-b16b-0fa8779c6c40 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.148366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cb457-7e0b-4555-b16b-0fa8779c6c40 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:42.273355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.275295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:42.289309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e795f54-24a8-44f4-b51c-b68aba2d038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:42.290207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795f54-24a8-44f4-b51c-b68aba2d038a admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.290668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795f54-24a8-44f4-b51c-b68aba2d038a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.291421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795f54-24a8-44f4-b51c-b68aba2d038a admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.292305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e795f54-24a8-44f4-b51c-b68aba2d038a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:42.295514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e795f54-24a8-44f4-b51c-b68aba2d038a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:42.318227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 911/1826] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:42 2021] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:42.323325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e795f54-24a8-44f4-b51c-b68aba2d038a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.338283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e795f54-24a8-44f4-b51c-b68aba2d038a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:42.344260 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b4eee-5334-42c4-8f43-ea2d9c1cb027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:42.358711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4eee-5334-42c4-8f43-ea2d9c1cb027 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.359986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4eee-5334-42c4-8f43-ea2d9c1cb027 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.360706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4eee-5334-42c4-8f43-ea2d9c1cb027 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.364077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b4eee-5334-42c4-8f43-ea2d9c1cb027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:42.367261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b4eee-5334-42c4-8f43-ea2d9c1cb027 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:42.397929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 912/1827] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:42 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:42.399196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b4eee-5334-42c4-8f43-ea2d9c1cb027 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.419606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b4eee-5334-42c4-8f43-ea2d9c1cb027 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:42.435655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4132e-e920-41dd-823c-c4998fc34db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:42.437046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4132e-e920-41dd-823c-c4998fc34db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.437556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4132e-e920-41dd-823c-c4998fc34db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.438030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12a41b-2a19-4fa4-9d96-32e0a7161c2f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:42.438267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4132e-e920-41dd-823c-c4998fc34db7 admin admin] PATH_INFO: `/v3/projects/be5bf11864ba4691a5ed49549250579b/users/4e13ec97fcfb4acf988893e75f12bdb1/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.443833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:42.445567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.446505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.446940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] PATH_INFO: `/v3/projects/31932750db0d46cd99171ebc0feef6a3` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.448484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31932750db0d46cd99171ebc0feef6a3)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:42.450892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:42.462912 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4132e-e920-41dd-823c-c4998fc34db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5bf11864ba4691a5ed49549250579b, user_id=4e13ec97fcfb4acf988893e75f12bdb1, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:42.466118 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4132e-e920-41dd-823c-c4998fc34db7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:42.493458 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 913/1828] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:42 2021] PUT /identity/v3/projects/be5bf11864ba4691a5ed49549250579b/users/4e13ec97fcfb4acf988893e75f12bdb1/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:42.499694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4132e-e920-41dd-823c-c4998fc34db7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.540330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31932750db0d46cd99171ebc0feef6a3', 'request_id': 'req-3b34a29f-58c7-4404-9121-8a47e3261e72'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.550586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31932750db0d46cd99171ebc0feef6a3', 'request_id': 'req-3b34a29f-58c7-4404-9121-8a47e3261e72'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.566544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31932750db0d46cd99171ebc0feef6a3', 'request_id': 'req-3b34a29f-58c7-4404-9121-8a47e3261e72'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.584363 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] The token cache is being invalidate because project 31932750db0d46cd99171ebc0feef6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:42.584651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.585553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.590861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 916/1829] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:42 2021] DELETE /identity/v3/projects/31932750db0d46cd99171ebc0feef6a3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:42.592072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.593077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4132e-e920-41dd-823c-c4998fc34db7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:42.593247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:42.696063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a29f-58c7-4404-9121-8a47e3261e72 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:42.702685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:42.703781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.703781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.704017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.704655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:42.708106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:42.710090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:42.711175 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.711540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.711920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] PATH_INFO: `/v3/users/49f76f3f044f4f09881d5f9066dad878` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.713251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f76f3f044f4f09881d5f9066dad878)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:42.715936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:42.735325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 914/1830] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:42 2021] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:42.739319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.748660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:42.765837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc78258-f675-41a9-9414-76d2a9f58116 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:42.770490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4ba3-4f98-473f-9323-4b7fa27891a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:42.771876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4ba3-4f98-473f-9323-4b7fa27891a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.772158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4ba3-4f98-473f-9323-4b7fa27891a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.772430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4ba3-4f98-473f-9323-4b7fa27891a3 admin admin] PATH_INFO: `/v3/projects/be5bf11864ba4691a5ed49549250579b/users/4e13ec97fcfb4acf988893e75f12bdb1/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.774398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a4ba3-4f98-473f-9323-4b7fa27891a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5bf11864ba4691a5ed49549250579b, user_id=4e13ec97fcfb4acf988893e75f12bdb1, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:42.777869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a4ba3-4f98-473f-9323-4b7fa27891a3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:42.790068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 915/1831] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:42 2021] PUT /identity/v3/projects/be5bf11864ba4691a5ed49549250579b/users/4e13ec97fcfb4acf988893e75f12bdb1/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:42.800300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e594-8af6-418d-abee-abe1b39cde39 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:42.800588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e594-8af6-418d-abee-abe1b39cde39 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:42.800865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e594-8af6-418d-abee-abe1b39cde39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:42.831561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-42e1e594-8af6-418d-abee-abe1b39cde39 None None] MFA Rules not processed for user `4e13ec97fcfb4acf988893e75f12bdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:42.832788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-42e1e594-8af6-418d-abee-abe1b39cde39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:42.896123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f76f3f044f4f09881d5f9066dad878'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.908618 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f76f3f044f4f09881d5f9066dad878'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.909311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f76f3f044f4f09881d5f9066dad878'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.920340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 916/1832] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:42 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:42.927502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f76f3f044f4f09881d5f9066dad878'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.928304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f76f3f044f4f09881d5f9066dad878'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:42.933978 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1e594-8af6-418d-abee-abe1b39cde39 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:42.936108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-42e1e594-8af6-418d-abee-abe1b39cde39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:42.942243 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 917/1833] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:42 2021] DELETE /identity/v3/users/49f76f3f044f4f09881d5f9066dad878 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:43.002124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1e594-8af6-418d-abee-abe1b39cde39 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:43.072320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:43.073195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:43.074469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:43.074879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:43.085999 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:43.171219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:43.172724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:43.182851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 917/1834] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:42 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:43.244486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:43.246023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:43.259086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64bc05-de9d-448c-8142-86eb1ade6bc6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:43.266234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f7c46-fb5f-4e5b-963a-2edce4549bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:43.267292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7c46-fb5f-4e5b-963a-2edce4549bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:43.267676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7c46-fb5f-4e5b-963a-2edce4549bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:43.268053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7c46-fb5f-4e5b-963a-2edce4549bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:43.270035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-530f7c46-fb5f-4e5b-963a-2edce4549bf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:43.346008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f7c46-fb5f-4e5b-963a-2edce4549bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:43.347567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f7c46-fb5f-4e5b-963a-2edce4549bf8 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:43.360178 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 918/1835] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:43 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:43.674233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:43.675623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:43.881792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878335a5-240f-4266-94d4-25588c56e0fa service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:43.890569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:43.891455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:43.891757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:43.892038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] PATH_INFO: `/v3/projects/5bb37105ed9b4d48af587e35ce9c79ef` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:43.893285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb37105ed9b4d48af587e35ce9c79ef)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:43.895796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:43.965189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb37105ed9b4d48af587e35ce9c79ef', 'request_id': 'req-f65c283a-7877-4b64-9374-25cd60f4bf17'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:43.974631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb37105ed9b4d48af587e35ce9c79ef', 'request_id': 'req-f65c283a-7877-4b64-9374-25cd60f4bf17'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:43.988668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb37105ed9b4d48af587e35ce9c79ef', 'request_id': 'req-f65c283a-7877-4b64-9374-25cd60f4bf17'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:44.005074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] The token cache is being invalidate because project 5bb37105ed9b4d48af587e35ce9c79ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:44.005641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:44.006656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f65c283a-7877-4b64-9374-25cd60f4bf17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:44.009545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 918/1836] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:43 2021] DELETE /identity/v3/projects/5bb37105ed9b4d48af587e35ce9c79ef => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:44.018484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77429c-27b7-4f7c-a681-d096be220e3c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.019005 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77429c-27b7-4f7c-a681-d096be220e3c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.019112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77429c-27b7-4f7c-a681-d096be220e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.039143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3f77429c-27b7-4f7c-a681-d096be220e3c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:44.040656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3f77429c-27b7-4f7c-a681-d096be220e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:44.177820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 919/1837] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:44.186414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c41805-bb36-4e6c-b9cb-d23a14596372 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.186705 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c41805-bb36-4e6c-b9cb-d23a14596372 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.186986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c41805-bb36-4e6c-b9cb-d23a14596372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.206168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-95c41805-bb36-4e6c-b9cb-d23a14596372 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:44.207346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-95c41805-bb36-4e6c-b9cb-d23a14596372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:44.215553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 919/1838] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:44.220057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77429c-27b7-4f7c-a681-d096be220e3c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.229057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77429c-27b7-4f7c-a681-d096be220e3c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.233516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.234535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.234824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.235099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.235865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:44.236170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.237789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.249883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 920/1839] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:44.254388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c41805-bb36-4e6c-b9cb-d23a14596372 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.263698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c41805-bb36-4e6c-b9cb-d23a14596372 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.270076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953be83-a0b1-4ab8-9fd6-c39265e34f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.270753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953be83-a0b1-4ab8-9fd6-c39265e34f90 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.271037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953be83-a0b1-4ab8-9fd6-c39265e34f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.271483 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953be83-a0b1-4ab8-9fd6-c39265e34f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.272238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953be83-a0b1-4ab8-9fd6-c39265e34f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.274208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953be83-a0b1-4ab8-9fd6-c39265e34f90 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.300770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 920/1840] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:44 2021] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:44.309687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.319127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e02b-4c3e-4d83-9037-55b0b785bffd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.372603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5507d-2b23-42c6-ae07-b07e3a2a42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.373284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5507d-2b23-42c6-ae07-b07e3a2a42aa admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.373568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5507d-2b23-42c6-ae07-b07e3a2a42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.373851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5507d-2b23-42c6-ae07-b07e3a2a42aa admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.374539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5507d-2b23-42c6-ae07-b07e3a2a42aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.376583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5507d-2b23-42c6-ae07-b07e3a2a42aa admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.397563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 921/1841] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:44 2021] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:44.401991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953be83-a0b1-4ab8-9fd6-c39265e34f90 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.413316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953be83-a0b1-4ab8-9fd6-c39265e34f90 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.418366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30ab93-79ff-45c2-afde-85e6b6f21ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.419071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30ab93-79ff-45c2-afde-85e6b6f21ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.419355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30ab93-79ff-45c2-afde-85e6b6f21ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.419637 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30ab93-79ff-45c2-afde-85e6b6f21ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.420396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30ab93-79ff-45c2-afde-85e6b6f21ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.422028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30ab93-79ff-45c2-afde-85e6b6f21ce0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.432288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 921/1842] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:44.436892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5507d-2b23-42c6-ae07-b07e3a2a42aa admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.446109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5507d-2b23-42c6-ae07-b07e3a2a42aa admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.451482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0e30f-ad7f-462c-8e0a-0ce76199ab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.452187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0e30f-ad7f-462c-8e0a-0ce76199ab21 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.452471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0e30f-ad7f-462c-8e0a-0ce76199ab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.452751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0e30f-ad7f-462c-8e0a-0ce76199ab21 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.453464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0e30f-ad7f-462c-8e0a-0ce76199ab21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.455041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0e30f-ad7f-462c-8e0a-0ce76199ab21 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.465085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 922/1843] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:44.469195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30ab93-79ff-45c2-afde-85e6b6f21ce0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.478281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30ab93-79ff-45c2-afde-85e6b6f21ce0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.482623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213f379-c1ce-4c6a-a6c2-f9bb94a1ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.483494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f379-c1ce-4c6a-a6c2-f9bb94a1ebf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.483826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f379-c1ce-4c6a-a6c2-f9bb94a1ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.484101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f379-c1ce-4c6a-a6c2-f9bb94a1ebf0 admin admin] PATH_INFO: `/v3/projects/db2f557ee1a94bad81eff0fae2737c21/users/b75f8c10852f45e1b0afe1e8b52e4555/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.498264 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213f379-c1ce-4c6a-a6c2-f9bb94a1ebf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2f557ee1a94bad81eff0fae2737c21, user_id=b75f8c10852f45e1b0afe1e8b52e4555, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.500963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213f379-c1ce-4c6a-a6c2-f9bb94a1ebf0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.517901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 922/1844] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:44 2021] PUT /identity/v3/projects/db2f557ee1a94bad81eff0fae2737c21/users/b75f8c10852f45e1b0afe1e8b52e4555/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:44.528272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352730-8368-49b0-b13f-5eb9f55b0ce2 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.528560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352730-8368-49b0-b13f-5eb9f55b0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.528865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352730-8368-49b0-b13f-5eb9f55b0ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.555094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-15352730-8368-49b0-b13f-5eb9f55b0ce2 None None] MFA Rules not processed for user `b75f8c10852f45e1b0afe1e8b52e4555`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:44.556588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-15352730-8368-49b0-b13f-5eb9f55b0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:44.624795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 923/1845] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:44 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:44.629289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213f379-c1ce-4c6a-a6c2-f9bb94a1ebf0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.698471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213f379-c1ce-4c6a-a6c2-f9bb94a1ebf0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.703536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a0bbf-b8bb-4985-bd85-e1ce9435fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.704269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a0bbf-b8bb-4985-bd85-e1ce9435fc21 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.704551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a0bbf-b8bb-4985-bd85-e1ce9435fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.707023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a0bbf-b8bb-4985-bd85-e1ce9435fc21 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.708093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a0bbf-b8bb-4985-bd85-e1ce9435fc21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.710964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a0bbf-b8bb-4985-bd85-e1ce9435fc21 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.746915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 923/1846] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:44 2021] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:44.750905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352730-8368-49b0-b13f-5eb9f55b0ce2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.763612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352730-8368-49b0-b13f-5eb9f55b0ce2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.829332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f14c-a04d-4678-8497-fc3c0c387d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.830218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f14c-a04d-4678-8497-fc3c0c387d16 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.830545 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f14c-a04d-4678-8497-fc3c0c387d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.830863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f14c-a04d-4678-8497-fc3c0c387d16 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.831730 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0f14c-a04d-4678-8497-fc3c0c387d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.833983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0f14c-a04d-4678-8497-fc3c0c387d16 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.856258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 924/1847] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:44 2021] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:44.860215 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a0bbf-b8bb-4985-bd85-e1ce9435fc21 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.869911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a0bbf-b8bb-4985-bd85-e1ce9435fc21 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.875355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65fc05-05ff-4edd-b5fc-5d04882cc293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.876248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65fc05-05ff-4edd-b5fc-5d04882cc293 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.876413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65fc05-05ff-4edd-b5fc-5d04882cc293 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.876675 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65fc05-05ff-4edd-b5fc-5d04882cc293 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.877395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65fc05-05ff-4edd-b5fc-5d04882cc293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.878979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65fc05-05ff-4edd-b5fc-5d04882cc293 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.889586 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 924/1848] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:44.893677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f14c-a04d-4678-8497-fc3c0c387d16 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.903481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f14c-a04d-4678-8497-fc3c0c387d16 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:44.914317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f2ed2-f8e9-4188-af0c-a4dd3b255983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:44.915225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f2ed2-f8e9-4188-af0c-a4dd3b255983 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:44.915502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f2ed2-f8e9-4188-af0c-a4dd3b255983 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:44.915810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f2ed2-f8e9-4188-af0c-a4dd3b255983 admin admin] PATH_INFO: `/v3/projects/2e84c9f376c848e386af8d842e37c113/users/ca2840f8ff714ccf96088e23298052b3/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:44.932455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f2ed2-f8e9-4188-af0c-a4dd3b255983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e84c9f376c848e386af8d842e37c113, user_id=ca2840f8ff714ccf96088e23298052b3, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:44.936519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f2ed2-f8e9-4188-af0c-a4dd3b255983 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:44.949770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 925/1849] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:44 2021] PUT /identity/v3/projects/2e84c9f376c848e386af8d842e37c113/users/ca2840f8ff714ccf96088e23298052b3/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:44.954304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65fc05-05ff-4edd-b5fc-5d04882cc293 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:44.966066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65fc05-05ff-4edd-b5fc-5d04882cc293 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:45.021968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aebab-c92c-4d1a-a4fb-a935590c63d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:45.022735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aebab-c92c-4d1a-a4fb-a935590c63d9 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:45.023022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aebab-c92c-4d1a-a4fb-a935590c63d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:45.023301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aebab-c92c-4d1a-a4fb-a935590c63d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:45.024178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14aebab-c92c-4d1a-a4fb-a935590c63d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:45.025635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14aebab-c92c-4d1a-a4fb-a935590c63d9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:45.039801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 925/1850] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:45.045033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f2ed2-f8e9-4188-af0c-a4dd3b255983 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:45.054890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f2ed2-f8e9-4188-af0c-a4dd3b255983 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:45.059948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:45.060817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:45.061095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:45.061377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] PATH_INFO: `/v3/projects/2e84c9f376c848e386af8d842e37c113/users/ca2840f8ff714ccf96088e23298052b3/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:45.063246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e84c9f376c848e386af8d842e37c113, user_id=ca2840f8ff714ccf96088e23298052b3, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:45.065921 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:45.084582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 926/1851] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:45 2021] PUT /identity/v3/projects/2e84c9f376c848e386af8d842e37c113/users/ca2840f8ff714ccf96088e23298052b3/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:45.088921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b00a-e939-4420-9d44-bad8f6083ad5 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:45.089984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b00a-e939-4420-9d44-bad8f6083ad5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:45.090781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b00a-e939-4420-9d44-bad8f6083ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:45.130926 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3ff4b00a-e939-4420-9d44-bad8f6083ad5 None None] MFA Rules not processed for user `ca2840f8ff714ccf96088e23298052b3`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:45.132234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3ff4b00a-e939-4420-9d44-bad8f6083ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:45.247341 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 926/1852] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:45 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:45.369467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:45.371574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:45.479625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6171788-61ed-4f39-a41d-aedb7f6668b4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:45.484561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf1d6f-7df1-4562-8c26-0adee9a117dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:45.485572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf1d6f-7df1-4562-8c26-0adee9a117dd service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:45.485998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf1d6f-7df1-4562-8c26-0adee9a117dd service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:45.486626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf1d6f-7df1-4562-8c26-0adee9a117dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:45.557369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf1d6f-7df1-4562-8c26-0adee9a117dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:45.559388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf1d6f-7df1-4562-8c26-0adee9a117dd service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:45.569156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 927/1853] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:45 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:46.590934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4b00a-e939-4420-9d44-bad8f6083ad5 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:46.592995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3ff4b00a-e939-4420-9d44-bad8f6083ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:46.658383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4b00a-e939-4420-9d44-bad8f6083ad5 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:46.662728 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:46.663601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:46.663916 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:46.664196 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] PATH_INFO: `/v3/users/3de6dedbcece4b91ba92bd8768871ff7` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:46.665336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de6dedbcece4b91ba92bd8768871ff7)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:46.667271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:46.717683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de6dedbcece4b91ba92bd8768871ff7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:46.739816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de6dedbcece4b91ba92bd8768871ff7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:46.748020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de6dedbcece4b91ba92bd8768871ff7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:46.749035 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de6dedbcece4b91ba92bd8768871ff7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:46.760703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de6dedbcece4b91ba92bd8768871ff7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:46.772581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 927/1854] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:46 2021] DELETE /identity/v3/users/3de6dedbcece4b91ba92bd8768871ff7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:46.774162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4b25-a664-4ee0-9016-b1ce1b3fd7aa None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:46.774631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4b25-a664-4ee0-9016-b1ce1b3fd7aa None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:46.774714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4b25-a664-4ee0-9016-b1ce1b3fd7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:46.793291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-56fc4b25-a664-4ee0-9016-b1ce1b3fd7aa None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:46.794642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-56fc4b25-a664-4ee0-9016-b1ce1b3fd7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:46.864319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 928/1855] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:46.874884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:46.876365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:46.935037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb6095-9af8-4e54-a92f-21e555239574 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:46.938503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b146e-a917-464e-8389-7cfab6885257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:46.939168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b146e-a917-464e-8389-7cfab6885257 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:46.939422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b146e-a917-464e-8389-7cfab6885257 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:46.939693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b146e-a917-464e-8389-7cfab6885257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:46.948801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b146e-a917-464e-8389-7cfab6885257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:46.950554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b146e-a917-464e-8389-7cfab6885257 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:46.959298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 928/1856] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:47.343838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc4b25-a664-4ee0-9016-b1ce1b3fd7aa None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:47.345445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-56fc4b25-a664-4ee0-9016-b1ce1b3fd7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:47.356680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc4b25-a664-4ee0-9016-b1ce1b3fd7aa None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:47.362497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:47.363437 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:47.364433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:47.364855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] PATH_INFO: `/v3/projects/1f9bfb64344f4e2789abb08b1be84a70` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:47.367246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9bfb64344f4e2789abb08b1be84a70)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:47.369195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:47.429956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9bfb64344f4e2789abb08b1be84a70', 'request_id': 'req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.437616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9bfb64344f4e2789abb08b1be84a70', 'request_id': 'req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.449375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9bfb64344f4e2789abb08b1be84a70', 'request_id': 'req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.462407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] The token cache is being invalidate because project 1f9bfb64344f4e2789abb08b1be84a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:47.462614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.463275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.465079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 929/1857] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:47 2021] DELETE /identity/v3/projects/1f9bfb64344f4e2789abb08b1be84a70 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:47.469889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b146e-a917-464e-8389-7cfab6885257 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:47.480324 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b146e-a917-464e-8389-7cfab6885257 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:47.579996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:47.581244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:47.581719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:47.582053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] PATH_INFO: `/v3/users/4e13ec97fcfb4acf988893e75f12bdb1` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:47.583472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e13ec97fcfb4acf988893e75f12bdb1)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:47.586013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:47.658717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e13ec97fcfb4acf988893e75f12bdb1'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.673591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e13ec97fcfb4acf988893e75f12bdb1'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.702823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e13ec97fcfb4acf988893e75f12bdb1'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.704101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e13ec97fcfb4acf988893e75f12bdb1'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.715418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-03544952-5c54-471d-a25b-68d9ee20c311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e13ec97fcfb4acf988893e75f12bdb1'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:47.727340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 929/1858] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:47 2021] DELETE /identity/v3/users/4e13ec97fcfb4acf988893e75f12bdb1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:48.096949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:48.099052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:48.119521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0865-a77c-4d0a-a0d1-70c5d13a1b3c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:48.204212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:48.205851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.206142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.206589 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] PATH_INFO: `/v3/projects/be5bf11864ba4691a5ed49549250579b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.207920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5bf11864ba4691a5ed49549250579b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:48.210053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:48.276420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5bf11864ba4691a5ed49549250579b', 'request_id': 'req-af3c3c94-3dd0-45f0-beab-d4541d50320b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:48.286287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5bf11864ba4691a5ed49549250579b', 'request_id': 'req-af3c3c94-3dd0-45f0-beab-d4541d50320b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:48.297894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5bf11864ba4691a5ed49549250579b', 'request_id': 'req-af3c3c94-3dd0-45f0-beab-d4541d50320b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:48.313460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] The token cache is being invalidate because project be5bf11864ba4691a5ed49549250579b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:48.317757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:48.318520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-af3c3c94-3dd0-45f0-beab-d4541d50320b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:48.320355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 930/1859] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:48 2021] DELETE /identity/v3/projects/be5bf11864ba4691a5ed49549250579b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:48.326897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1921f-aadb-4019-b4a8-7137a3e6205b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.327997 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1921f-aadb-4019-b4a8-7137a3e6205b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.328304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1921f-aadb-4019-b4a8-7137a3e6205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.361849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-a2f1921f-aadb-4019-b4a8-7137a3e6205b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:48.363593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a2f1921f-aadb-4019-b4a8-7137a3e6205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:48.437556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 930/1860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:48.445222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675bf18-48f0-4320-9bac-354d93b67ed3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.445512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675bf18-48f0-4320-9bac-354d93b67ed3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.445790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675bf18-48f0-4320-9bac-354d93b67ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.465665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3675bf18-48f0-4320-9bac-354d93b67ed3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:48.467509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3675bf18-48f0-4320-9bac-354d93b67ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:48.485636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 931/1861] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:48.486337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1921f-aadb-4019-b4a8-7137a3e6205b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:48.497810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1921f-aadb-4019-b4a8-7137a3e6205b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:48.502664 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:48.503638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.504064 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.504431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.505222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:48.505517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:48.507404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:48.525444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675bf18-48f0-4320-9bac-354d93b67ed3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:48.531186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 931/1862] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:37:48.536045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675bf18-48f0-4320-9bac-354d93b67ed3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:48.543542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fca58-2211-41a5-87c1-c2a4218c9de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:48.544523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fca58-2211-41a5-87c1-c2a4218c9de4 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.545554 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fca58-2211-41a5-87c1-c2a4218c9de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.545975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fca58-2211-41a5-87c1-c2a4218c9de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.546811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fca58-2211-41a5-87c1-c2a4218c9de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:48.549806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fca58-2211-41a5-87c1-c2a4218c9de4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:48.593577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 932/1863] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:48 2021] POST /identity/v3/projects => generated 401 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:48.598561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:48.611756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f050bf-c50b-4bfa-9ae5-6b113812c321 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:48.666735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06691b0b-d7a9-4605-8ab9-bf5495b14d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:48.668117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06691b0b-d7a9-4605-8ab9-bf5495b14d1f admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.668333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06691b0b-d7a9-4605-8ab9-bf5495b14d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.668598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06691b0b-d7a9-4605-8ab9-bf5495b14d1f admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.669318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06691b0b-d7a9-4605-8ab9-bf5495b14d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:48.671239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06691b0b-d7a9-4605-8ab9-bf5495b14d1f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:48.690540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 932/1864] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:48 2021] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:48.694708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fca58-2211-41a5-87c1-c2a4218c9de4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:48.704527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fca58-2211-41a5-87c1-c2a4218c9de4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:48.709112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb62d6-ae35-4bfa-8da6-9bb4ffd868e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:48.709805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb62d6-ae35-4bfa-8da6-9bb4ffd868e2 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.710146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb62d6-ae35-4bfa-8da6-9bb4ffd868e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.710378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb62d6-ae35-4bfa-8da6-9bb4ffd868e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.711101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb62d6-ae35-4bfa-8da6-9bb4ffd868e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:48.712753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb62d6-ae35-4bfa-8da6-9bb4ffd868e2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:48.724419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 933/1865] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:48.728701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06691b0b-d7a9-4605-8ab9-bf5495b14d1f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:48.739386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06691b0b-d7a9-4605-8ab9-bf5495b14d1f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:48.745263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356362a5-a4d2-4b59-b73b-6fdcb6373bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:48.746171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356362a5-a4d2-4b59-b73b-6fdcb6373bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.746578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356362a5-a4d2-4b59-b73b-6fdcb6373bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.746871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356362a5-a4d2-4b59-b73b-6fdcb6373bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.747789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356362a5-a4d2-4b59-b73b-6fdcb6373bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:48.758719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356362a5-a4d2-4b59-b73b-6fdcb6373bb0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:48.768733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 933/1866] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:48 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:48.772770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb62d6-ae35-4bfa-8da6-9bb4ffd868e2 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:48.783244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb62d6-ae35-4bfa-8da6-9bb4ffd868e2 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:48.787700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168680-5d04-4a38-a6be-ef2865c8f3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:48.788729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168680-5d04-4a38-a6be-ef2865c8f3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.789011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168680-5d04-4a38-a6be-ef2865c8f3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.789291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168680-5d04-4a38-a6be-ef2865c8f3c6 admin admin] PATH_INFO: `/v3/projects/21ece4329f15415194ed9343e5115727/users/62727ddc1703423888326e95f309ed86/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.807929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec168680-5d04-4a38-a6be-ef2865c8f3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ece4329f15415194ed9343e5115727, user_id=62727ddc1703423888326e95f309ed86, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:48.811048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec168680-5d04-4a38-a6be-ef2865c8f3c6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:48.830744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 934/1867] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:48 2021] PUT /identity/v3/projects/21ece4329f15415194ed9343e5115727/users/62727ddc1703423888326e95f309ed86/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:48.842461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1646f-382f-4f5f-9e67-1b52381c62eb None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:48.843065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1646f-382f-4f5f-9e67-1b52381c62eb None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:48.843532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1646f-382f-4f5f-9e67-1b52381c62eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:48.882522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1ab1646f-382f-4f5f-9e67-1b52381c62eb None None] MFA Rules not processed for user `62727ddc1703423888326e95f309ed86`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:48.884390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1ab1646f-382f-4f5f-9e67-1b52381c62eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:48.982500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 934/1868] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:48 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:48.987274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168680-5d04-4a38-a6be-ef2865c8f3c6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:49.053563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168680-5d04-4a38-a6be-ef2865c8f3c6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:49.058727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895e29-b171-4155-979c-175d30e03c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:49.059434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895e29-b171-4155-979c-175d30e03c58 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.059678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895e29-b171-4155-979c-175d30e03c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.060030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895e29-b171-4155-979c-175d30e03c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.060790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e895e29-b171-4155-979c-175d30e03c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:49.062694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e895e29-b171-4155-979c-175d30e03c58 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:49.098333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 935/1869] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:48 2021] POST /identity/v3/projects => generated 399 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:49.103081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1646f-382f-4f5f-9e67-1b52381c62eb None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:49.114867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1646f-382f-4f5f-9e67-1b52381c62eb None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:49.184786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be564c-8b0d-403a-9290-85da5d0b11c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:49.185452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be564c-8b0d-403a-9290-85da5d0b11c7 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.185734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be564c-8b0d-403a-9290-85da5d0b11c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.186012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be564c-8b0d-403a-9290-85da5d0b11c7 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.186710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be564c-8b0d-403a-9290-85da5d0b11c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:49.188715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be564c-8b0d-403a-9290-85da5d0b11c7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:49.207511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 935/1870] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:49 2021] POST /identity/v3/users => generated 306 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:49.211591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895e29-b171-4155-979c-175d30e03c58 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:49.221984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895e29-b171-4155-979c-175d30e03c58 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:49.226320 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59b418-6979-4405-a757-a36036905953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:49.226973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59b418-6979-4405-a757-a36036905953 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.227257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59b418-6979-4405-a757-a36036905953 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.227532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59b418-6979-4405-a757-a36036905953 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.228281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59b418-6979-4405-a757-a36036905953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:49.229983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59b418-6979-4405-a757-a36036905953 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:49.240087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 936/1871] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:49.244160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be564c-8b0d-403a-9290-85da5d0b11c7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:49.253508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be564c-8b0d-403a-9290-85da5d0b11c7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:49.258174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df764-bcd6-4f53-aac3-f140373f56cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:49.259082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df764-bcd6-4f53-aac3-f140373f56cf admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.259369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df764-bcd6-4f53-aac3-f140373f56cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.259648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df764-bcd6-4f53-aac3-f140373f56cf admin admin] PATH_INFO: `/v3/projects/2b1a02f8a73d46ac8fc7030c5b215f2e/users/52fc171490fe49f7a1f3f658a4ad6fcd/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.274529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df764-bcd6-4f53-aac3-f140373f56cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1a02f8a73d46ac8fc7030c5b215f2e, user_id=52fc171490fe49f7a1f3f658a4ad6fcd, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:49.277865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df764-bcd6-4f53-aac3-f140373f56cf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:49.290662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 936/1872] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:49 2021] PUT /identity/v3/projects/2b1a02f8a73d46ac8fc7030c5b215f2e/users/52fc171490fe49f7a1f3f658a4ad6fcd/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:49.294779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59b418-6979-4405-a757-a36036905953 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:49.304049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59b418-6979-4405-a757-a36036905953 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:49.358141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2a2da-42e5-40dd-8798-32ae76ca2f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:49.358795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2a2da-42e5-40dd-8798-32ae76ca2f95 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.359074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2a2da-42e5-40dd-8798-32ae76ca2f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.359353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2a2da-42e5-40dd-8798-32ae76ca2f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.360088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2a2da-42e5-40dd-8798-32ae76ca2f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:49.361670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2a2da-42e5-40dd-8798-32ae76ca2f95 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:49.371774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 937/1873] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:49 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:49.375949 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df764-bcd6-4f53-aac3-f140373f56cf admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:49.385350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df764-bcd6-4f53-aac3-f140373f56cf admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:49.390655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:49.391521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.391829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.392192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] PATH_INFO: `/v3/projects/2b1a02f8a73d46ac8fc7030c5b215f2e/users/52fc171490fe49f7a1f3f658a4ad6fcd/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.394060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1a02f8a73d46ac8fc7030c5b215f2e, user_id=52fc171490fe49f7a1f3f658a4ad6fcd, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:49.396736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:49.407518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 937/1874] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:49 2021] PUT /identity/v3/projects/2b1a02f8a73d46ac8fc7030c5b215f2e/users/52fc171490fe49f7a1f3f658a4ad6fcd/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:49.418819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b62b8-8f65-4e2c-95a4-f6427ffd3f06 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.418819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b62b8-8f65-4e2c-95a4-f6427ffd3f06 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.418819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b62b8-8f65-4e2c-95a4-f6427ffd3f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.445396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-4c6b62b8-8f65-4e2c-95a4-f6427ffd3f06 None None] MFA Rules not processed for user `52fc171490fe49f7a1f3f658a4ad6fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:49.446552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4c6b62b8-8f65-4e2c-95a4-f6427ffd3f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:49.517755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 938/1875] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:49 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:49.528872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:49.530616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:49.595389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332f7c7-6c86-48f3-b71c-f14cd73edb49 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:49.599411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5431-1fce-456e-9449-07f1101dcc31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:49.600101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5431-1fce-456e-9449-07f1101dcc31 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.600385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5431-1fce-456e-9449-07f1101dcc31 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.600682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5431-1fce-456e-9449-07f1101dcc31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.611500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a5431-1fce-456e-9449-07f1101dcc31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:49.612963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a5431-1fce-456e-9449-07f1101dcc31 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:49.626714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 938/1876] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:49 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:49.713503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b62b8-8f65-4e2c-95a4-f6427ffd3f06 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:49.715587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4c6b62b8-8f65-4e2c-95a4-f6427ffd3f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:49.731355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b62b8-8f65-4e2c-95a4-f6427ffd3f06 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:49.735024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:49.735682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:49.736007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:49.736284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:49.798859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:49.800420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:49.809298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 939/1877] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:49 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:50.260836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5431-1fce-456e-9449-07f1101dcc31 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:50.270662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5431-1fce-456e-9449-07f1101dcc31 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:50.274186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54d663-dbcc-49e4-8f4a-8f299af5bfbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:50.274837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d663-dbcc-49e4-8f4a-8f299af5bfbb service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:50.275120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d663-dbcc-49e4-8f4a-8f299af5bfbb service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:50.275398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d663-dbcc-49e4-8f4a-8f299af5bfbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:50.277283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8c54d663-dbcc-49e4-8f4a-8f299af5bfbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:50.340725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54d663-dbcc-49e4-8f4a-8f299af5bfbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:50.342738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54d663-dbcc-49e4-8f4a-8f299af5bfbb service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:50.352530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 939/1878] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:50 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:53.798446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:53.800118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:53.877207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e54fb0-5817-4910-8170-2dbac8726ba5 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:53.882709 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:53.883617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:53.883929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:53.884203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] PATH_INFO: `/v3/users/c4e3440a6d0544efbadd98059e84ffe8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:53.885395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e3440a6d0544efbadd98059e84ffe8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:53.887569 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:53.949821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e3440a6d0544efbadd98059e84ffe8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:53.975036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e3440a6d0544efbadd98059e84ffe8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:53.975036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e3440a6d0544efbadd98059e84ffe8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:53.981136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e3440a6d0544efbadd98059e84ffe8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:53.981470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e3440a6d0544efbadd98059e84ffe8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.001895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 940/1879] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:53 2021] DELETE /identity/v3/users/c4e3440a6d0544efbadd98059e84ffe8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:54.006499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76000-a96b-466c-ab2a-47c7a895d2f3 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:54.007345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76000-a96b-466c-ab2a-47c7a895d2f3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:54.007798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76000-a96b-466c-ab2a-47c7a895d2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:54.027098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2fc76000-a96b-466c-ab2a-47c7a895d2f3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:54.029438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2fc76000-a96b-466c-ab2a-47c7a895d2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:54.101580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 940/1880] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:54.116813 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:54.121954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:54.129147 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76000-a96b-466c-ab2a-47c7a895d2f3 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:54.137833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2fc76000-a96b-466c-ab2a-47c7a895d2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:54.150414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76000-a96b-466c-ab2a-47c7a895d2f3 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:54.156225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:54.157330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:54.157621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:54.157907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] PATH_INFO: `/v3/users/62727ddc1703423888326e95f309ed86` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:54.159109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62727ddc1703423888326e95f309ed86)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:54.161151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:54.204769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e4f50-48ce-404a-8906-47cfb0d4e4b1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:54.210886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c0ad0-e5ac-48b1-9a8a-251c3906f522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:54.211856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0ad0-e5ac-48b1-9a8a-251c3906f522 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:54.212160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0ad0-e5ac-48b1-9a8a-251c3906f522 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:54.212421 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0ad0-e5ac-48b1-9a8a-251c3906f522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:54.235840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62727ddc1703423888326e95f309ed86'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.239619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c0ad0-e5ac-48b1-9a8a-251c3906f522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:54.241983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c0ad0-e5ac-48b1-9a8a-251c3906f522 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:54.254461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62727ddc1703423888326e95f309ed86'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.266079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62727ddc1703423888326e95f309ed86'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.267197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62727ddc1703423888326e95f309ed86'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.271887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 941/1881] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:54.301066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62727ddc1703423888326e95f309ed86'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.313265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 941/1882] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:54 2021] DELETE /identity/v3/users/62727ddc1703423888326e95f309ed86 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:54.320161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4989-1507-42c6-a913-8859aabc3eee None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:54.320932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4989-1507-42c6-a913-8859aabc3eee None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:54.321548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4989-1507-42c6-a913-8859aabc3eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:54.359250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8fbc4989-1507-42c6-a913-8859aabc3eee None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:54.361680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8fbc4989-1507-42c6-a913-8859aabc3eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:54.459784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 942/1883] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:54.471052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:54.472612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:54.540756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360a9e4-2169-493e-bd12-4cde511022a9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:54.544685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf63f2-9caa-4e0c-9006-3a49d03a1a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:54.545452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf63f2-9caa-4e0c-9006-3a49d03a1a52 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:54.545744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf63f2-9caa-4e0c-9006-3a49d03a1a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:54.546021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf63f2-9caa-4e0c-9006-3a49d03a1a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:54.561015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf63f2-9caa-4e0c-9006-3a49d03a1a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:54.562521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf63f2-9caa-4e0c-9006-3a49d03a1a52 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:54.574387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 942/1884] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:54.798256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc4989-1507-42c6-a913-8859aabc3eee None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:54.800982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8fbc4989-1507-42c6-a913-8859aabc3eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:54.839512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc4989-1507-42c6-a913-8859aabc3eee None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:54.852557 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:54.853959 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:54.854255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:54.854537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] PATH_INFO: `/v3/projects/5ee6db99e7b8406ba6c2e17f1b070fe2` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:54.857731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee6db99e7b8406ba6c2e17f1b070fe2)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:54.860213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:54.921630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee6db99e7b8406ba6c2e17f1b070fe2', 'request_id': 'req-7c9f105b-41d6-4950-a712-d768c23f170f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.929020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee6db99e7b8406ba6c2e17f1b070fe2', 'request_id': 'req-7c9f105b-41d6-4950-a712-d768c23f170f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.938676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee6db99e7b8406ba6c2e17f1b070fe2', 'request_id': 'req-7c9f105b-41d6-4950-a712-d768c23f170f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.953404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] The token cache is being invalidate because project 5ee6db99e7b8406ba6c2e17f1b070fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:54.953953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.955671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:54.958817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 943/1885] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:54 2021] DELETE /identity/v3/projects/5ee6db99e7b8406ba6c2e17f1b070fe2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:54.962832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf63f2-9caa-4e0c-9006-3a49d03a1a52 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:54.973115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf63f2-9caa-4e0c-9006-3a49d03a1a52 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:55.068150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:55.069842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:55.070331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:55.070674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] PATH_INFO: `/v3/users/dbc0d79ec29a4ae28eeb61b0c38fb5f3` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:55.072404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc0d79ec29a4ae28eeb61b0c38fb5f3)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:55.075402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:55.145092 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc0d79ec29a4ae28eeb61b0c38fb5f3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.152606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:55.153981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:55.174860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f105b-41d6-4950-a712-d768c23f170f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:55.185815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:55.186758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:55.187045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:55.187319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] PATH_INFO: `/v3/projects/21ece4329f15415194ed9343e5115727` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:55.189102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ece4329f15415194ed9343e5115727)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:55.191064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:55.193248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc0d79ec29a4ae28eeb61b0c38fb5f3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.202540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc0d79ec29a4ae28eeb61b0c38fb5f3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.203496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc0d79ec29a4ae28eeb61b0c38fb5f3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.216111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc0d79ec29a4ae28eeb61b0c38fb5f3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.226525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 943/1886] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:54 2021] DELETE /identity/v3/users/dbc0d79ec29a4ae28eeb61b0c38fb5f3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:55.268947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ece4329f15415194ed9343e5115727', 'request_id': 'req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.275906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ece4329f15415194ed9343e5115727', 'request_id': 'req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.285549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ece4329f15415194ed9343e5115727', 'request_id': 'req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.300555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] The token cache is being invalidate because project 21ece4329f15415194ed9343e5115727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:55.300657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.301286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.305737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 944/1887] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:55 2021] DELETE /identity/v3/projects/21ece4329f15415194ed9343e5115727 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:55.308935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:55.310660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:55.414357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae9855-8a6d-4150-bac7-be87d3558661 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:55.487693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:55.488662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:55.488883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:55.489155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] PATH_INFO: `/v3/users/52fc171490fe49f7a1f3f658a4ad6fcd` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:55.490409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fc171490fe49f7a1f3f658a4ad6fcd)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:55.492381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:55.507621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:55.517515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:55.543164 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de142e4-6a2f-49ff-ab21-2e95d83d0f9b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:55.548760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:55.549841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:55.550216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:55.550507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] PATH_INFO: `/v3/users/b75f8c10852f45e1b0afe1e8b52e4555` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:55.552003 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75f8c10852f45e1b0afe1e8b52e4555)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:55.554238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:55.590982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fc171490fe49f7a1f3f658a4ad6fcd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.613996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fc171490fe49f7a1f3f658a4ad6fcd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.622480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fc171490fe49f7a1f3f658a4ad6fcd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.623477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fc171490fe49f7a1f3f658a4ad6fcd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.636934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75f8c10852f45e1b0afe1e8b52e4555'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.637704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fc171490fe49f7a1f3f658a4ad6fcd'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.647298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 944/1888] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:55 2021] DELETE /identity/v3/users/52fc171490fe49f7a1f3f658a4ad6fcd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:55.647298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:55.649667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75f8c10852f45e1b0afe1e8b52e4555'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.650363 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75f8c10852f45e1b0afe1e8b52e4555'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.653492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:55.659759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75f8c10852f45e1b0afe1e8b52e4555'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.660392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-89e05cb6-9d6e-4ee3-9b6d-f9652f446105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75f8c10852f45e1b0afe1e8b52e4555'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.676063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 945/1889] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:55 2021] DELETE /identity/v3/users/b75f8c10852f45e1b0afe1e8b52e4555 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:55.684223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4afde-e0e5-45ea-ae09-56ef8b3b6ea9 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:55.684223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4afde-e0e5-45ea-ae09-56ef8b3b6ea9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:55.684223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4afde-e0e5-45ea-ae09-56ef8b3b6ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:55.700275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-0cc4afde-e0e5-45ea-ae09-56ef8b3b6ea9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:55.701615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0cc4afde-e0e5-45ea-ae09-56ef8b3b6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:55.745137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d0a44-c13e-4f2b-9715-0c080f180340 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:55.782522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 946/1890] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:55.804783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4afde-e0e5-45ea-ae09-56ef8b3b6ea9 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:55.806528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0cc4afde-e0e5-45ea-ae09-56ef8b3b6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:55.809827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:55.810702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:55.810982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:55.811302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] PATH_INFO: `/v3/projects/f93d5f01d8d74a978515f1f56b98be4d` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:55.812491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93d5f01d8d74a978515f1f56b98be4d)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:55.814440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:55.874990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93d5f01d8d74a978515f1f56b98be4d', 'request_id': 'req-6cae520f-7076-4d67-ad4d-40fe908f5d17'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.875468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4afde-e0e5-45ea-ae09-56ef8b3b6ea9 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:55.881988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93d5f01d8d74a978515f1f56b98be4d', 'request_id': 'req-6cae520f-7076-4d67-ad4d-40fe908f5d17'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.890330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93d5f01d8d74a978515f1f56b98be4d', 'request_id': 'req-6cae520f-7076-4d67-ad4d-40fe908f5d17'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.901294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] The token cache is being invalidate because project f93d5f01d8d74a978515f1f56b98be4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:55.901873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.902543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6cae520f-7076-4d67-ad4d-40fe908f5d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:55.904345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 945/1891] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:55 2021] DELETE /identity/v3/projects/f93d5f01d8d74a978515f1f56b98be4d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:55.909978 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4de6-0977-48bb-98fe-e2baa1c52851 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:55.910271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4de6-0977-48bb-98fe-e2baa1c52851 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:55.912128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4de6-0977-48bb-98fe-e2baa1c52851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:55.935105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:55.936389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:55.936792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:55.938700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:55.944506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:55.946289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6ffa4de6-0977-48bb-98fe-e2baa1c52851 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:55.947630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6ffa4de6-0977-48bb-98fe-e2baa1c52851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.017788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.019514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.020102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 946/1892] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:56.022113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67d1a0-1371-473b-8871-12488d6234a0 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.022502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67d1a0-1371-473b-8871-12488d6234a0 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.022925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67d1a0-1371-473b-8871-12488d6234a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.030682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 947/1893] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:56.061485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3a67d1a0-1371-473b-8871-12488d6234a0 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:56.062904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3a67d1a0-1371-473b-8871-12488d6234a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.076208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 947/1894] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:56.079487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.095321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a6e48-1490-43ee-88f5-a1c10064055d service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.101361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.102445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.102753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.103220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.104162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:56.104555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.108144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.131632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 948/1895] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:56.136952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67d1a0-1371-473b-8871-12488d6234a0 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.146814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67d1a0-1371-473b-8871-12488d6234a0 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.152386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.153079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.153332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.153740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.154448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.156375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.191823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 948/1896] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:56.195835 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.210451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b337b-4f29-41ea-a2c3-433deabe49b9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.224881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.226907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.293435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8167833-29c2-484e-9f86-d78950843ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.294111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8167833-29c2-484e-9f86-d78950843ecc admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.294387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8167833-29c2-484e-9f86-d78950843ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.294658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8167833-29c2-484e-9f86-d78950843ecc admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.295342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8167833-29c2-484e-9f86-d78950843ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.297295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8167833-29c2-484e-9f86-d78950843ecc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.306505 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420ee77-f1d1-4bca-b404-955c1990f328 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.313396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.314452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.314921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.315262 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] PATH_INFO: `/v3/projects/2b1a02f8a73d46ac8fc7030c5b215f2e` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.316522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1a02f8a73d46ac8fc7030c5b215f2e)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.318504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.321268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 949/1897] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:56.325636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8167833-29c2-484e-9f86-d78950843ecc admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.341658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8167833-29c2-484e-9f86-d78950843ecc admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.347668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbf812-6d0e-411b-b7aa-fa72d554952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.348492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbf812-6d0e-411b-b7aa-fa72d554952e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.348880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbf812-6d0e-411b-b7aa-fa72d554952e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.349280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbf812-6d0e-411b-b7aa-fa72d554952e admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.350114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbf812-6d0e-411b-b7aa-fa72d554952e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.351974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbf812-6d0e-411b-b7aa-fa72d554952e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.363701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 950/1898] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:56 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:56.368824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbf812-6d0e-411b-b7aa-fa72d554952e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.380704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbf812-6d0e-411b-b7aa-fa72d554952e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.386712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1a02f8a73d46ac8fc7030c5b215f2e', 'request_id': 'req-c55d1275-c55c-44c1-bca8-09c1cdff010b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.394040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1a02f8a73d46ac8fc7030c5b215f2e', 'request_id': 'req-c55d1275-c55c-44c1-bca8-09c1cdff010b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.402537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1a02f8a73d46ac8fc7030c5b215f2e', 'request_id': 'req-c55d1275-c55c-44c1-bca8-09c1cdff010b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.415530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] The token cache is being invalidate because project 2b1a02f8a73d46ac8fc7030c5b215f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:56.415905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.419383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.423871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 949/1899] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:56 2021] DELETE /identity/v3/projects/2b1a02f8a73d46ac8fc7030c5b215f2e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:56.423871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.423871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.482496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d32c13-a925-4817-9078-e0eb770b46d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.483169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32c13-a925-4817-9078-e0eb770b46d9 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.483448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32c13-a925-4817-9078-e0eb770b46d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.483737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32c13-a925-4817-9078-e0eb770b46d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.484483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d32c13-a925-4817-9078-e0eb770b46d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.486236 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d32c13-a925-4817-9078-e0eb770b46d9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.496423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 951/1900] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:56 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:56.497681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6995f-cb92-41c8-af3b-5756f32e9809 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.498058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6995f-cb92-41c8-af3b-5756f32e9809 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.498237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6995f-cb92-41c8-af3b-5756f32e9809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.507921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1275-c55c-44c1-bca8-09c1cdff010b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.512670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.513541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.513822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.514097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] PATH_INFO: `/v3/projects/db2f557ee1a94bad81eff0fae2737c21` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.515290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2f557ee1a94bad81eff0fae2737c21)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.517241 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.520267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-7bc6995f-cb92-41c8-af3b-5756f32e9809 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:56.521823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7bc6995f-cb92-41c8-af3b-5756f32e9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.533874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 952/1901] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:56.534825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6995f-cb92-41c8-af3b-5756f32e9809 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.536176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7bc6995f-cb92-41c8-af3b-5756f32e9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.548740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6995f-cb92-41c8-af3b-5756f32e9809 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.555045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566860de-7a0a-49ac-9f85-d2e24a7c1ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.556279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566860de-7a0a-49ac-9f85-d2e24a7c1ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.556787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566860de-7a0a-49ac-9f85-d2e24a7c1ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.557109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566860de-7a0a-49ac-9f85-d2e24a7c1ddf admin admin] PATH_INFO: `/v3/projects/63cb81b834b54b91b1cbbd27c56baa81/users/847af1223ac6484298b76161cb97b30a/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.571221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2f557ee1a94bad81eff0fae2737c21', 'request_id': 'req-c36f909e-d29d-46c5-b614-60bfffc711c7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.573285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566860de-7a0a-49ac-9f85-d2e24a7c1ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cb81b834b54b91b1cbbd27c56baa81, user_id=847af1223ac6484298b76161cb97b30a, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.576687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566860de-7a0a-49ac-9f85-d2e24a7c1ddf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.578176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2f557ee1a94bad81eff0fae2737c21', 'request_id': 'req-c36f909e-d29d-46c5-b614-60bfffc711c7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.586747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2f557ee1a94bad81eff0fae2737c21', 'request_id': 'req-c36f909e-d29d-46c5-b614-60bfffc711c7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.592152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 953/1902] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:56 2021] PUT /identity/v3/projects/63cb81b834b54b91b1cbbd27c56baa81/users/847af1223ac6484298b76161cb97b30a/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:56.593515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb23a-e849-4137-ba38-68808fd8e089 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.593879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb23a-e849-4137-ba38-68808fd8e089 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.594480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb23a-e849-4137-ba38-68808fd8e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.603161 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] The token cache is being invalidate because project db2f557ee1a94bad81eff0fae2737c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:56.603526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.604268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c36f909e-d29d-46c5-b614-60bfffc711c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.606076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 950/1903] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:56 2021] DELETE /identity/v3/projects/db2f557ee1a94bad81eff0fae2737c21 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:56.607693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09293-7984-457d-b6d7-f2f19266df42 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.608751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09293-7984-457d-b6d7-f2f19266df42 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.608957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09293-7984-457d-b6d7-f2f19266df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.619608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fa6fb23a-e849-4137-ba38-68808fd8e089 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:56.621199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fa6fb23a-e849-4137-ba38-68808fd8e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.638954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-4ab09293-7984-457d-b6d7-f2f19266df42 None None] MFA Rules not processed for user `847af1223ac6484298b76161cb97b30a`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:56.640336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4ab09293-7984-457d-b6d7-f2f19266df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.684291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 954/1904] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:56.685296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb23a-e849-4137-ba38-68808fd8e089 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.688947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fa6fb23a-e849-4137-ba38-68808fd8e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.700617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb23a-e849-4137-ba38-68808fd8e089 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.704870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.705731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.706006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.706277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] PATH_INFO: `/v3/users/ca2840f8ff714ccf96088e23298052b3` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.707584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2840f8ff714ccf96088e23298052b3)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.708982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 951/1905] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:56.709717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.709817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09293-7984-457d-b6d7-f2f19266df42 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.721868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09293-7984-457d-b6d7-f2f19266df42 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.743873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.744583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.744872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.745156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.746274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:56.746658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.748145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.765072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 952/1906] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:56.765927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.767633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.785041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2840f8ff714ccf96088e23298052b3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.785364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153ba34-5b85-438c-a1c8-7a714c14ac93 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.790065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.790735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.791023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.791317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.792004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.794365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.798782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2840f8ff714ccf96088e23298052b3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.799360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2840f8ff714ccf96088e23298052b3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.807090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2840f8ff714ccf96088e23298052b3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.808528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2840f8ff714ccf96088e23298052b3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:56.821673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 953/1907] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:56.822545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.825352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.825494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 955/1908] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:56 2021] DELETE /identity/v3/users/ca2840f8ff714ccf96088e23298052b3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:56.826308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.827699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:56.896974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc752-d5b5-490f-9205-0e28bafc727a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.902587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682488-80df-42fc-8e97-5ea259b65139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.903497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682488-80df-42fc-8e97-5ea259b65139 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.903497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682488-80df-42fc-8e97-5ea259b65139 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.903752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682488-80df-42fc-8e97-5ea259b65139 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.904351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a682488-80df-42fc-8e97-5ea259b65139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.906315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a682488-80df-42fc-8e97-5ea259b65139 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.907511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a999e-4fb8-41bb-ac66-b1d02e0d977c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:56.912788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc674a-cac8-43f0-9b75-9e8adb898e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:56.913812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc674a-cac8-43f0-9b75-9e8adb898e63 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:56.914065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc674a-cac8-43f0-9b75-9e8adb898e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:56.914448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc674a-cac8-43f0-9b75-9e8adb898e63 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:56.915288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc674a-cac8-43f0-9b75-9e8adb898e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:56.917487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc674a-cac8-43f0-9b75-9e8adb898e63 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:56.937169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 954/1909] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:56.941427 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682488-80df-42fc-8e97-5ea259b65139 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.943251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 956/1910] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:56.948366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc674a-cac8-43f0-9b75-9e8adb898e63 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:56.960594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc674a-cac8-43f0-9b75-9e8adb898e63 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.022584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682488-80df-42fc-8e97-5ea259b65139 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.025000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e4f09-44f8-43e8-9367-854f371baede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.025393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e4f09-44f8-43e8-9367-854f371baede admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.025573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e4f09-44f8-43e8-9367-854f371baede admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.026023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e4f09-44f8-43e8-9367-854f371baede admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.026746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e4f09-44f8-43e8-9367-854f371baede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.028555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e4f09-44f8-43e8-9367-854f371baede admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.028931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a432-e89c-4594-b106-06c61dcee5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.029773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a432-e89c-4594-b106-06c61dcee5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.030011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a432-e89c-4594-b106-06c61dcee5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.030356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a432-e89c-4594-b106-06c61dcee5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.031057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a432-e89c-4594-b106-06c61dcee5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.033054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a432-e89c-4594-b106-06c61dcee5f4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.039271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 957/1911] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:56 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:57.043463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e4f09-44f8-43e8-9367-854f371baede admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.053591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e4f09-44f8-43e8-9367-854f371baede admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.060499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36686fca-12ec-4f3d-878c-d83edec890ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.061004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36686fca-12ec-4f3d-878c-d83edec890ff admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.061288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36686fca-12ec-4f3d-878c-d83edec890ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.061563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36686fca-12ec-4f3d-878c-d83edec890ff admin admin] PATH_INFO: `/v3/projects/45d8302b69d6463d81e9b5b7be378490/users/b51db0a996c84070a07371da3b2d18ba/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.065243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 955/1912] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:56 2021] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:57.066542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a432-e89c-4594-b106-06c61dcee5f4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.077816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a432-e89c-4594-b106-06c61dcee5f4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.079983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36686fca-12ec-4f3d-878c-d83edec890ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d8302b69d6463d81e9b5b7be378490, user_id=b51db0a996c84070a07371da3b2d18ba, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.082586 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668497d-7371-40bb-a590-b184c9a78ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.083644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668497d-7371-40bb-a590-b184c9a78ccf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.083784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36686fca-12ec-4f3d-878c-d83edec890ff admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.083881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668497d-7371-40bb-a590-b184c9a78ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.084468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668497d-7371-40bb-a590-b184c9a78ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.085489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668497d-7371-40bb-a590-b184c9a78ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.087324 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668497d-7371-40bb-a590-b184c9a78ccf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.102515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 958/1913] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:57 2021] PUT /identity/v3/projects/45d8302b69d6463d81e9b5b7be378490/users/b51db0a996c84070a07371da3b2d18ba/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:37:57.106328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36686fca-12ec-4f3d-878c-d83edec890ff admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.109099 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 956/1914] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:57.112705 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668497d-7371-40bb-a590-b184c9a78ccf admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.125716 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668497d-7371-40bb-a590-b184c9a78ccf admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.195287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36686fca-12ec-4f3d-878c-d83edec890ff admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.201323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.202075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.202294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.202718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.203306 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.205583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.223165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 959/1915] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:57.224178 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.225995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.238596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bacaa-93e4-4603-81d9-b82d63669f85 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.243238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.244160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.244445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.244744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] PATH_INFO: `/v3/projects/2e84c9f376c848e386af8d842e37c113` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.246465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e84c9f376c848e386af8d842e37c113)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.248475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.298241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e84c9f376c848e386af8d842e37c113', 'request_id': 'req-c84c724d-0ae1-4767-9e89-bdcd51a847b1'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:57.305117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e84c9f376c848e386af8d842e37c113', 'request_id': 'req-c84c724d-0ae1-4767-9e89-bdcd51a847b1'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:57.312353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e84c9f376c848e386af8d842e37c113', 'request_id': 'req-c84c724d-0ae1-4767-9e89-bdcd51a847b1'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:57.322706 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] The token cache is being invalidate because project 2e84c9f376c848e386af8d842e37c113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:37:57.322996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:57.324242 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:57.326213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 960/1916] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:37:57 2021] DELETE /identity/v3/projects/2e84c9f376c848e386af8d842e37c113 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:57.326352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f4a35-7a4a-45a7-8732-2dfc36d436a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.326708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.327368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f4a35-7a4a-45a7-8732-2dfc36d436a2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.327659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f4a35-7a4a-45a7-8732-2dfc36d436a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.328041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f4a35-7a4a-45a7-8732-2dfc36d436a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.328421 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.328958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f4a35-7a4a-45a7-8732-2dfc36d436a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.330531 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f4a35-7a4a-45a7-8732-2dfc36d436a2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.343971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 957/1917] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:37:57.343971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cf4a3-3ac8-4d96-8c4d-46a949c01c90 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.343971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cf4a3-3ac8-4d96-8c4d-46a949c01c90 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.343971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cf4a3-3ac8-4d96-8c4d-46a949c01c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.359994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-4c7cf4a3-3ac8-4d96-8c4d-46a949c01c90 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:57.361155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4c7cf4a3-3ac8-4d96-8c4d-46a949c01c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.395323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c724d-0ae1-4767-9e89-bdcd51a847b1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.399904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.400785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.401065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.401345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] PATH_INFO: `/v3/projects/45d8302b69d6463d81e9b5b7be378490/users/b51db0a996c84070a07371da3b2d18ba/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.403229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d8302b69d6463d81e9b5b7be378490, user_id=b51db0a996c84070a07371da3b2d18ba, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.405885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.415954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 961/1918] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:57 2021] PUT /identity/v3/projects/45d8302b69d6463d81e9b5b7be378490/users/b51db0a996c84070a07371da3b2d18ba/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:57.417026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 958/1919] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:57.417794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.419672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.432690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ff43-f6ec-4e44-9bfd-efdc1eca145d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.433648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ff43-f6ec-4e44-9bfd-efdc1eca145d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.433965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ff43-f6ec-4e44-9bfd-efdc1eca145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.451413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ed97ff43-f6ec-4e44-9bfd-efdc1eca145d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:57.453053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ed97ff43-f6ec-4e44-9bfd-efdc1eca145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.490638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd069e-8b60-4d73-bd8e-a6d6772c3d37 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.498604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e840-2dc2-4908-ad86-2b7d544d7d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.499556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e840-2dc2-4908-ad86-2b7d544d7d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.499868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e840-2dc2-4908-ad86-2b7d544d7d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.500145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e840-2dc2-4908-ad86-2b7d544d7d8c admin admin] PATH_INFO: `/v3/projects/56aeab2fddc949af8a1e7f24e3329033/users/ad01c59811934c6aaf2d31b9b465610c/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.520283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e840-2dc2-4908-ad86-2b7d544d7d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aeab2fddc949af8a1e7f24e3329033, user_id=ad01c59811934c6aaf2d31b9b465610c, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.523392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e840-2dc2-4908-ad86-2b7d544d7d8c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.528924 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 959/1920] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:57.530538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339277-47f1-4909-8acf-c5f95da20fef None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.531742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339277-47f1-4909-8acf-c5f95da20fef None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.531742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339277-47f1-4909-8acf-c5f95da20fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.550430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 962/1921] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:57 2021] PUT /identity/v3/projects/56aeab2fddc949af8a1e7f24e3329033/users/ad01c59811934c6aaf2d31b9b465610c/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:57.551996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90a071-6abe-40c5-9414-09f6d09272bf None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.552290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90a071-6abe-40c5-9414-09f6d09272bf None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.552586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90a071-6abe-40c5-9414-09f6d09272bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.566197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ea339277-47f1-4909-8acf-c5f95da20fef None None] MFA Rules not processed for user `b51db0a996c84070a07371da3b2d18ba`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:57.567393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ea339277-47f1-4909-8acf-c5f95da20fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.572615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fa90a071-6abe-40c5-9414-09f6d09272bf None None] MFA Rules not processed for user `f3ecf43d42c74783a82bf45afd8826e8`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:57.574272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fa90a071-6abe-40c5-9414-09f6d09272bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.630632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 963/1922] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:57.631946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90a071-6abe-40c5-9414-09f6d09272bf None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.635541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 960/1923] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:57.638323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d5ef-76f1-4393-93c5-3c7bdb32f34c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.638608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d5ef-76f1-4393-93c5-3c7bdb32f34c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.638880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d5ef-76f1-4393-93c5-3c7bdb32f34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.668631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5b20d5ef-76f1-4393-93c5-3c7bdb32f34c None None] MFA Rules not processed for user `ad01c59811934c6aaf2d31b9b465610c`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:57.669793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5b20d5ef-76f1-4393-93c5-3c7bdb32f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.703615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90a071-6abe-40c5-9414-09f6d09272bf None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.708043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.708700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.708981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.709251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.709976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:37:57.710331 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.712062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.725312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 964/1924] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:37:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:37:57.726708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.728502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:57.743865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 961/1925] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:57.744686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d5ef-76f1-4393-93c5-3c7bdb32f34c None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.755434 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d5ef-76f1-4393-93c5-3c7bdb32f34c None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.760325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0d25f-b20a-4671-950e-312c8e938ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.761613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d25f-b20a-4671-950e-312c8e938ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.762191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d25f-b20a-4671-950e-312c8e938ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.762191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d25f-b20a-4671-950e-312c8e938ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.762890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0d25f-b20a-4671-950e-312c8e938ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.764887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0d25f-b20a-4671-950e-312c8e938ef0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.792998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487564-7757-4145-b3a2-86e66561518b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.798871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 962/1926] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:57.798871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0d25f-b20a-4671-950e-312c8e938ef0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.800012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d699c-e1c4-48da-b40b-1d0bb234ade2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.800735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d699c-e1c4-48da-b40b-1d0bb234ade2 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.801111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d699c-e1c4-48da-b40b-1d0bb234ade2 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.801426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d699c-e1c4-48da-b40b-1d0bb234ade2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.811904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d699c-e1c4-48da-b40b-1d0bb234ade2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.813342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d699c-e1c4-48da-b40b-1d0bb234ade2 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.826699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 965/1927] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:57 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:57.828606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d699c-e1c4-48da-b40b-1d0bb234ade2 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.846746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d699c-e1c4-48da-b40b-1d0bb234ade2 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.879412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0d25f-b20a-4671-950e-312c8e938ef0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:57.884287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eff65-5eb9-4e14-acc5-3452a8bed9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.884962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eff65-5eb9-4e14-acc5-3452a8bed9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.885246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eff65-5eb9-4e14-acc5-3452a8bed9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.885520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eff65-5eb9-4e14-acc5-3452a8bed9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.886826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eff65-5eb9-4e14-acc5-3452a8bed9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.888849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eff65-5eb9-4e14-acc5-3452a8bed9d7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.920744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 963/1928] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:57.924731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eff65-5eb9-4e14-acc5-3452a8bed9d7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:57.931941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248accd-05b0-44ba-b26f-a7520fcb63a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:57.933826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248accd-05b0-44ba-b26f-a7520fcb63a3 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:57.934112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248accd-05b0-44ba-b26f-a7520fcb63a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:57.934394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248accd-05b0-44ba-b26f-a7520fcb63a3 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:57.935084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248accd-05b0-44ba-b26f-a7520fcb63a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:57.937039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248accd-05b0-44ba-b26f-a7520fcb63a3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:57.972416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 966/1929] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:37:57.973881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248accd-05b0-44ba-b26f-a7520fcb63a3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.024202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eff65-5eb9-4e14-acc5-3452a8bed9d7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.028925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11b22f-e1e2-4b9a-973d-f18ab19d029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.029602 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11b22f-e1e2-4b9a-973d-f18ab19d029f admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.029876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11b22f-e1e2-4b9a-973d-f18ab19d029f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.030150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11b22f-e1e2-4b9a-973d-f18ab19d029f admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.030838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11b22f-e1e2-4b9a-973d-f18ab19d029f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.032892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11b22f-e1e2-4b9a-973d-f18ab19d029f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.036102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248accd-05b0-44ba-b26f-a7520fcb63a3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.055394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 964/1930] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:37:57 2021] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:37:58.055394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11b22f-e1e2-4b9a-973d-f18ab19d029f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.071691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11b22f-e1e2-4b9a-973d-f18ab19d029f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.077561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35a020-86f7-419e-b8ae-c8d658cc3e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.078232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35a020-86f7-419e-b8ae-c8d658cc3e5b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.078783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35a020-86f7-419e-b8ae-c8d658cc3e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.078783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35a020-86f7-419e-b8ae-c8d658cc3e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.079490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35a020-86f7-419e-b8ae-c8d658cc3e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.081121 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35a020-86f7-419e-b8ae-c8d658cc3e5b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.095527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 965/1931] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:58.096413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35a020-86f7-419e-b8ae-c8d658cc3e5b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.102829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.104318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.105321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.105778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.108441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:58.124421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35a020-86f7-419e-b8ae-c8d658cc3e5b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.130050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01f61f-9b89-43b8-b2e3-cb6453cf3598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.131039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01f61f-9b89-43b8-b2e3-cb6453cf3598 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.131039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01f61f-9b89-43b8-b2e3-cb6453cf3598 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.131269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01f61f-9b89-43b8-b2e3-cb6453cf3598 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.132029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01f61f-9b89-43b8-b2e3-cb6453cf3598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.133625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01f61f-9b89-43b8-b2e3-cb6453cf3598 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.144516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 966/1932] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:58.147806 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01f61f-9b89-43b8-b2e3-cb6453cf3598 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.154920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01f61f-9b89-43b8-b2e3-cb6453cf3598 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.160601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c662-288d-4f5b-b947-b51745cc58f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.161321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c662-288d-4f5b-b947-b51745cc58f7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.161604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c662-288d-4f5b-b947-b51745cc58f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.162055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c662-288d-4f5b-b947-b51745cc58f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.162826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224c662-288d-4f5b-b947-b51745cc58f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.169587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224c662-288d-4f5b-b947-b51745cc58f7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.175284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 967/1933] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:58.176202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c662-288d-4f5b-b947-b51745cc58f7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.188424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c662-288d-4f5b-b947-b51745cc58f7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.192833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e4e3a-473e-4cbe-b617-8b15a21bd45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.193770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e4e3a-473e-4cbe-b617-8b15a21bd45c admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.194086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e4e3a-473e-4cbe-b617-8b15a21bd45c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.194361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e4e3a-473e-4cbe-b617-8b15a21bd45c admin admin] PATH_INFO: `/v3/projects/b2ba057893bf43e2820e90042eb69f69/users/5e2336d4814147a29610afdd8b7d5306/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.204180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.206113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.211010 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e4e3a-473e-4cbe-b617-8b15a21bd45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ba057893bf43e2820e90042eb69f69, user_id=5e2336d4814147a29610afdd8b7d5306, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.213771 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e4e3a-473e-4cbe-b617-8b15a21bd45c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.216387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 967/1934] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:57 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:58.217016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.231015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598df2-24b7-489a-a6cb-1d929764fa38 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.242796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 968/1935] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:58 2021] PUT /identity/v3/projects/b2ba057893bf43e2820e90042eb69f69/users/5e2336d4814147a29610afdd8b7d5306/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:58.251749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e4e3a-473e-4cbe-b617-8b15a21bd45c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.345307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4d983-f099-48d5-864a-8475eeb1b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.346204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4d983-f099-48d5-864a-8475eeb1b09b admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.346533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4d983-f099-48d5-864a-8475eeb1b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.346811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4d983-f099-48d5-864a-8475eeb1b09b admin admin] PATH_INFO: `/v3/projects/2de201c7aac9481ea57219faaeba86c9/users/40105d3c3fc4462888b90a36ee40e6e9/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.367346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4d983-f099-48d5-864a-8475eeb1b09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de201c7aac9481ea57219faaeba86c9, user_id=40105d3c3fc4462888b90a36ee40e6e9, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.370357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4d983-f099-48d5-864a-8475eeb1b09b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.397704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e4e3a-473e-4cbe-b617-8b15a21bd45c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.404862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 968/1936] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:58 2021] PUT /identity/v3/projects/2de201c7aac9481ea57219faaeba86c9/users/40105d3c3fc4462888b90a36ee40e6e9/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:58.415856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9be53f-e222-4744-a594-6b21eabf1790 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.416144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9be53f-e222-4744-a594-6b21eabf1790 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.416420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9be53f-e222-4744-a594-6b21eabf1790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.446275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fa9be53f-e222-4744-a594-6b21eabf1790 None None] MFA Rules not processed for user `40105d3c3fc4462888b90a36ee40e6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:58.447656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fa9be53f-e222-4744-a594-6b21eabf1790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:58.497241 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354327a-70c5-4f8a-aec5-98372fbbafd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.497924 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354327a-70c5-4f8a-aec5-98372fbbafd8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.498201 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354327a-70c5-4f8a-aec5-98372fbbafd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.498472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354327a-70c5-4f8a-aec5-98372fbbafd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.499194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354327a-70c5-4f8a-aec5-98372fbbafd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.501320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354327a-70c5-4f8a-aec5-98372fbbafd8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.516050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 969/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:37:58.517134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354327a-70c5-4f8a-aec5-98372fbbafd8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.527475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354327a-70c5-4f8a-aec5-98372fbbafd8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.528866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 969/1938] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:58 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:58.534272 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebbc6f-e1c6-4631-af3b-1be8c2208616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.535358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebbc6f-e1c6-4631-af3b-1be8c2208616 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.535649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebbc6f-e1c6-4631-af3b-1be8c2208616 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.535965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebbc6f-e1c6-4631-af3b-1be8c2208616 admin admin] PATH_INFO: `/v3/projects/b2ba057893bf43e2820e90042eb69f69/users/5e2336d4814147a29610afdd8b7d5306/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.537997 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebbc6f-e1c6-4631-af3b-1be8c2208616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ba057893bf43e2820e90042eb69f69, user_id=5e2336d4814147a29610afdd8b7d5306, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.540561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9be53f-e222-4744-a594-6b21eabf1790 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.541110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebbc6f-e1c6-4631-af3b-1be8c2208616 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.554192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 970/1939] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:37:58 2021] PUT /identity/v3/projects/b2ba057893bf43e2820e90042eb69f69/users/5e2336d4814147a29610afdd8b7d5306/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:58.565097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa088b-161e-474c-8292-3da684d11b38 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.565386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa088b-161e-474c-8292-3da684d11b38 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.565664 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa088b-161e-474c-8292-3da684d11b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.600522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-46fa088b-161e-474c-8292-3da684d11b38 None None] MFA Rules not processed for user `5e2336d4814147a29610afdd8b7d5306`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:58.602100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-46fa088b-161e-474c-8292-3da684d11b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:58.618435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9be53f-e222-4744-a594-6b21eabf1790 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.678319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 971/1940] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:58 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:37:58.691031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50154104-9e5d-4b93-b304-0e46b95ac54f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.691576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154104-9e5d-4b93-b304-0e46b95ac54f service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.691896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154104-9e5d-4b93-b304-0e46b95ac54f service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.692318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154104-9e5d-4b93-b304-0e46b95ac54f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.694652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa088b-161e-474c-8292-3da684d11b38 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:58.695828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-46fa088b-161e-474c-8292-3da684d11b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:58.708842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa088b-161e-474c-8292-3da684d11b38 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:58.712282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c52483-787c-4ac1-be48-8d8d3a595b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:58.712932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c52483-787c-4ac1-be48-8d8d3a595b41 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:58.713214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c52483-787c-4ac1-be48-8d8d3a595b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:58.713488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c52483-787c-4ac1-be48-8d8d3a595b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:58.723289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c52483-787c-4ac1-be48-8d8d3a595b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.724827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c52483-787c-4ac1-be48-8d8d3a595b41 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.734373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 972/1941] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:58 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:58.753615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50154104-9e5d-4b93-b304-0e46b95ac54f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:58.755469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50154104-9e5d-4b93-b304-0e46b95ac54f service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:58.769190 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 970/1942] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:58 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:59.099794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c52483-787c-4ac1-be48-8d8d3a595b41 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:59.184320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c52483-787c-4ac1-be48-8d8d3a595b41 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:59.188623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:59.189485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:59.189905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:59.190319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] PATH_INFO: `/v3/users/ad01c59811934c6aaf2d31b9b465610c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:59.191283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad01c59811934c6aaf2d31b9b465610c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:59.193808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:59.244951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad01c59811934c6aaf2d31b9b465610c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:59.257023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad01c59811934c6aaf2d31b9b465610c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:59.264295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad01c59811934c6aaf2d31b9b465610c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:59.265027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad01c59811934c6aaf2d31b9b465610c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:59.273967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad01c59811934c6aaf2d31b9b465610c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:37:59.282986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 973/1943] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:37:59 2021] DELETE /identity/v3/users/ad01c59811934c6aaf2d31b9b465610c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:37:59.289097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604770de-eb88-421a-ac13-86f7c2275e63 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:59.289542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604770de-eb88-421a-ac13-86f7c2275e63 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:59.289767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604770de-eb88-421a-ac13-86f7c2275e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:59.309189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-604770de-eb88-421a-ac13-86f7c2275e63 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:37:59.310393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-604770de-eb88-421a-ac13-86f7c2275e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:59.375964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 971/1944] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:37:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:37:59.386205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:37:59.396126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:37:59.481501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96938-0cc2-40f5-b396-fda8ca5e45b0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:37:59.486998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9ec5d-0ffa-490c-a191-7b2219250a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:37:59.487832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ec5d-0ffa-490c-a191-7b2219250a0f service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:37:59.488118 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ec5d-0ffa-490c-a191-7b2219250a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:37:59.488395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ec5d-0ffa-490c-a191-7b2219250a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:37:59.505777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9ec5d-0ffa-490c-a191-7b2219250a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:37:59.507405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9ec5d-0ffa-490c-a191-7b2219250a0f service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:37:59.522814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 974/1945] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:37:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:00.011056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604770de-eb88-421a-ac13-86f7c2275e63 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:00.013376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-604770de-eb88-421a-ac13-86f7c2275e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:00.025102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604770de-eb88-421a-ac13-86f7c2275e63 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:00.030319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:00.031191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:00.031477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:00.037851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] PATH_INFO: `/v3/projects/56aeab2fddc949af8a1e7f24e3329033` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:00.039510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aeab2fddc949af8a1e7f24e3329033)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:00.041153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:00.105346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aeab2fddc949af8a1e7f24e3329033', 'request_id': 'req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.111639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aeab2fddc949af8a1e7f24e3329033', 'request_id': 'req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.128484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aeab2fddc949af8a1e7f24e3329033', 'request_id': 'req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.141719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] The token cache is being invalidate because project 56aeab2fddc949af8a1e7f24e3329033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:00.142023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.142681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.144562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 972/1946] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:00 2021] DELETE /identity/v3/projects/56aeab2fddc949af8a1e7f24e3329033 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:00.148315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9ec5d-0ffa-490c-a191-7b2219250a0f service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:00.158051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9ec5d-0ffa-490c-a191-7b2219250a0f service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:00.230693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:00.231927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:00.232267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:00.232715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] PATH_INFO: `/v3/users/5e2336d4814147a29610afdd8b7d5306` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:00.234036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2336d4814147a29610afdd8b7d5306)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:00.237134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:00.312730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2336d4814147a29610afdd8b7d5306'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.325540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2336d4814147a29610afdd8b7d5306'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.336750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2336d4814147a29610afdd8b7d5306'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.337700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2336d4814147a29610afdd8b7d5306'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.346660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-441fddb7-42b4-4f39-8539-13c2ddb88907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2336d4814147a29610afdd8b7d5306'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:00.356643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 975/1947] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:00 2021] DELETE /identity/v3/users/5e2336d4814147a29610afdd8b7d5306 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:00.843371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:00.845299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:00.861158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd243f9-2fe6-456f-ac28-ad9fc4782c96 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:00.931122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:00.932131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:00.932432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:00.932709 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] PATH_INFO: `/v3/projects/b2ba057893bf43e2820e90042eb69f69` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:00.934656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ba057893bf43e2820e90042eb69f69)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:00.936838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:00.993258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ba057893bf43e2820e90042eb69f69', 'request_id': 'req-0ef4c187-d23c-4787-88ff-3195b56fc841'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.000695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ba057893bf43e2820e90042eb69f69', 'request_id': 'req-0ef4c187-d23c-4787-88ff-3195b56fc841'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.009266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ba057893bf43e2820e90042eb69f69', 'request_id': 'req-0ef4c187-d23c-4787-88ff-3195b56fc841'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.022647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] The token cache is being invalidate because project b2ba057893bf43e2820e90042eb69f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:01.023438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.024283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.027765 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 973/1948] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:00 2021] DELETE /identity/v3/projects/b2ba057893bf43e2820e90042eb69f69 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:01.037372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010967f6-4ba1-46ac-b222-735aba5d8c33 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.037722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010967f6-4ba1-46ac-b222-735aba5d8c33 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.038167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010967f6-4ba1-46ac-b222-735aba5d8c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.061817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-010967f6-4ba1-46ac-b222-735aba5d8c33 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:01.063143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-010967f6-4ba1-46ac-b222-735aba5d8c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.117483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.118910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.131893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 976/1949] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:01.138255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c187-d23c-4787-88ff-3195b56fc841 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.140930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e63691-890f-4447-9479-ce1474fb25cb None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.141248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e63691-890f-4447-9479-ce1474fb25cb None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.141523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e63691-890f-4447-9479-ce1474fb25cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.144483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.145432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.145768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.146145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] PATH_INFO: `/v3/users/847af1223ac6484298b76161cb97b30a` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.147495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=847af1223ac6484298b76161cb97b30a)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.149789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.161183 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-94e63691-890f-4447-9479-ce1474fb25cb None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:01.164971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-94e63691-890f-4447-9479-ce1474fb25cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.175638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 977/1950] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:01.179740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e63691-890f-4447-9479-ce1474fb25cb None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.190321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e63691-890f-4447-9479-ce1474fb25cb None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.196684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.197461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.197847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.198225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.199570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:01.199971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.201628 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.208001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847af1223ac6484298b76161cb97b30a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.214879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 978/1951] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:38:01.219654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.223906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847af1223ac6484298b76161cb97b30a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.224810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847af1223ac6484298b76161cb97b30a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.230627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48937-1f58-4675-bd3d-24f05a97a19b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.233530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847af1223ac6484298b76161cb97b30a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.234671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a6f1ee2b-d87f-439f-ad84-d3096ee114b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847af1223ac6484298b76161cb97b30a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:01.236548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.237437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.237810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.238286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.239182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.241559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.249579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 974/1952] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:01 2021] DELETE /identity/v3/users/847af1223ac6484298b76161cb97b30a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:01.253762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5c4e-7b44-4816-82f6-7e6b8a7fb5d3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.254056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5c4e-7b44-4816-82f6-7e6b8a7fb5d3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.254348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5c4e-7b44-4816-82f6-7e6b8a7fb5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.271630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 979/1953] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:01 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:01.275592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.278062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.282430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-11ee5c4e-7b44-4816-82f6-7e6b8a7fb5d3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:01.283603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-11ee5c4e-7b44-4816-82f6-7e6b8a7fb5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.360512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305f0db-6033-49e7-b2d5-4148a241df40 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.365260 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e21b16-dba8-4846-acb7-e5f9d8822ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.365941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21b16-dba8-4846-acb7-e5f9d8822ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.366231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21b16-dba8-4846-acb7-e5f9d8822ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.366504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21b16-dba8-4846-acb7-e5f9d8822ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.367193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e21b16-dba8-4846-acb7-e5f9d8822ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.369138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e21b16-dba8-4846-acb7-e5f9d8822ac4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.369261 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 975/1954] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:01.381604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee5c4e-7b44-4816-82f6-7e6b8a7fb5d3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.383501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-11ee5c4e-7b44-4816-82f6-7e6b8a7fb5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.393609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 980/1955] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:01 2021] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:01.397726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e21b16-dba8-4846-acb7-e5f9d8822ac4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.406701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e21b16-dba8-4846-acb7-e5f9d8822ac4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.411952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd83d-94ab-4ebb-aa2d-27ff7b946520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.412620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd83d-94ab-4ebb-aa2d-27ff7b946520 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.413058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd83d-94ab-4ebb-aa2d-27ff7b946520 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.413626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd83d-94ab-4ebb-aa2d-27ff7b946520 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.414493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd83d-94ab-4ebb-aa2d-27ff7b946520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.416385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd83d-94ab-4ebb-aa2d-27ff7b946520 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.426761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 981/1956] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:01.430671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd83d-94ab-4ebb-aa2d-27ff7b946520 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.440517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd83d-94ab-4ebb-aa2d-27ff7b946520 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.444956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be89383-9945-43ee-9d6f-38a1f4835196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.445614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89383-9945-43ee-9d6f-38a1f4835196 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.445899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89383-9945-43ee-9d6f-38a1f4835196 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.446175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89383-9945-43ee-9d6f-38a1f4835196 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.446939 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be89383-9945-43ee-9d6f-38a1f4835196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.447042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee5c4e-7b44-4816-82f6-7e6b8a7fb5d3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.448603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be89383-9945-43ee-9d6f-38a1f4835196 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.453486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6a836-a5d2-4686-9d47-32731e614081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.455817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a836-a5d2-4686-9d47-32731e614081 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.455817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a836-a5d2-4686-9d47-32731e614081 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.455817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a836-a5d2-4686-9d47-32731e614081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.459231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 982/1957] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:01.463098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be89383-9945-43ee-9d6f-38a1f4835196 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.472314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a836-a5d2-4686-9d47-32731e614081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.472826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be89383-9945-43ee-9d6f-38a1f4835196 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.475375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a836-a5d2-4686-9d47-32731e614081 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.477532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.478446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.478727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.478996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] PATH_INFO: `/v3/projects/271e9f884bfa42eaa5fea564d19e2f41/users/ff38e25abdb7463ab57ee1d5c53f8273/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.492960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 976/1958] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:38:01.499234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=271e9f884bfa42eaa5fea564d19e2f41, user_id=ff38e25abdb7463ab57ee1d5c53f8273, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.502032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.528201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425ef4-d936-40be-b4ed-6bad2a9f6a71 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.528496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425ef4-d936-40be-b4ed-6bad2a9f6a71 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.528769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425ef4-d936-40be-b4ed-6bad2a9f6a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.530101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 983/1959] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:01 2021] PUT /identity/v3/projects/271e9f884bfa42eaa5fea564d19e2f41/users/ff38e25abdb7463ab57ee1d5c53f8273/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:01.563025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-84425ef4-d936-40be-b4ed-6bad2a9f6a71 None None] MFA Rules not processed for user `ff38e25abdb7463ab57ee1d5c53f8273`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:01.564830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-84425ef4-d936-40be-b4ed-6bad2a9f6a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.680097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 977/1960] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:01.694631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.703246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.768363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccafe5-b4d5-4623-a082-08a40e0c42ce admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.772350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.773213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.774513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.775001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.785801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.787496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.819891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 984/1961] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:01.832673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84425ef4-d936-40be-b4ed-6bad2a9f6a71 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.834282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-84425ef4-d936-40be-b4ed-6bad2a9f6a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:01.932987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84425ef4-d936-40be-b4ed-6bad2a9f6a71 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:01.938060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:01.938933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:01.939216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:01.939492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] PATH_INFO: `/v3/projects/63cb81b834b54b91b1cbbd27c56baa81` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:01.940840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cb81b834b54b91b1cbbd27c56baa81)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:01.942814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:01.994452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:01.996769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:02.008265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cb81b834b54b91b1cbbd27c56baa81', 'request_id': 'req-78102972-4ad0-4fa0-a292-e0a49d97422d'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.013901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250edda-04cb-446e-8f6d-8421b1f9ad4a service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:02.016709 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cb81b834b54b91b1cbbd27c56baa81', 'request_id': 'req-78102972-4ad0-4fa0-a292-e0a49d97422d'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.028341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cb81b834b54b91b1cbbd27c56baa81', 'request_id': 'req-78102972-4ad0-4fa0-a292-e0a49d97422d'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.044350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] The token cache is being invalidate because project 63cb81b834b54b91b1cbbd27c56baa81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:02.044637 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.048386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.055935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 978/1962] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:01 2021] DELETE /identity/v3/projects/63cb81b834b54b91b1cbbd27c56baa81 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:02.060625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:02.062668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:02.104503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:02.105578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.105853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.106127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] PATH_INFO: `/v3/users/40105d3c3fc4462888b90a36ee40e6e9` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.107543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40105d3c3fc4462888b90a36ee40e6e9)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:02.109516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:02.156493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78102972-4ad0-4fa0-a292-e0a49d97422d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:02.161827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:02.162796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.169078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.169366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] PATH_INFO: `/v3/users/b51db0a996c84070a07371da3b2d18ba` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.171077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51db0a996c84070a07371da3b2d18ba)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:02.173140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:02.173845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40105d3c3fc4462888b90a36ee40e6e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.194527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40105d3c3fc4462888b90a36ee40e6e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.205282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40105d3c3fc4462888b90a36ee40e6e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.206089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40105d3c3fc4462888b90a36ee40e6e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.231307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f87890da-960f-4965-a732-06f10a4a0422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40105d3c3fc4462888b90a36ee40e6e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.238990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 985/1963] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:01 2021] DELETE /identity/v3/users/40105d3c3fc4462888b90a36ee40e6e9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:02.243773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b72d-000b-40e2-909e-16fee47059f5 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.244234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51db0a996c84070a07371da3b2d18ba'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.244385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b72d-000b-40e2-909e-16fee47059f5 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.244680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b72d-000b-40e2-909e-16fee47059f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.257934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51db0a996c84070a07371da3b2d18ba'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.258697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51db0a996c84070a07371da3b2d18ba'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.264495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f6c9b72d-000b-40e2-909e-16fee47059f5 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:02.265715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f6c9b72d-000b-40e2-909e-16fee47059f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:02.267057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51db0a996c84070a07371da3b2d18ba'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.268324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51db0a996c84070a07371da3b2d18ba'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.281862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 979/1964] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:02 2021] DELETE /identity/v3/users/b51db0a996c84070a07371da3b2d18ba => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:02.335768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 986/1965] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:02.349103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:02.350956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:02.418624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb11ab8-bf73-4be5-9f0f-324426679e36 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:02.424105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe97bb-32a6-4963-9118-81adf6402066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:02.425226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe97bb-32a6-4963-9118-81adf6402066 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.425512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe97bb-32a6-4963-9118-81adf6402066 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.425789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe97bb-32a6-4963-9118-81adf6402066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.497376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe97bb-32a6-4963-9118-81adf6402066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:02.499155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe97bb-32a6-4963-9118-81adf6402066 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:02.512084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 980/1966] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:38:02.684789 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9b72d-000b-40e2-909e-16fee47059f5 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:02.686990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f6c9b72d-000b-40e2-909e-16fee47059f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:02.698248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9b72d-000b-40e2-909e-16fee47059f5 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:02.709438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:02.710464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.710755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.711050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] PATH_INFO: `/v3/projects/45d8302b69d6463d81e9b5b7be378490` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.712331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d8302b69d6463d81e9b5b7be378490)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:02.714404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:02.784065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d8302b69d6463d81e9b5b7be378490', 'request_id': 'req-2846ce5f-a277-4b12-9cfe-626033554a35'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.791700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d8302b69d6463d81e9b5b7be378490', 'request_id': 'req-2846ce5f-a277-4b12-9cfe-626033554a35'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.804174 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d8302b69d6463d81e9b5b7be378490', 'request_id': 'req-2846ce5f-a277-4b12-9cfe-626033554a35'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.817863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] The token cache is being invalidate because project 45d8302b69d6463d81e9b5b7be378490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:02.818182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.818715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2846ce5f-a277-4b12-9cfe-626033554a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:02.820323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 987/1967] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:02 2021] DELETE /identity/v3/projects/45d8302b69d6463d81e9b5b7be378490 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:02.827685 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c550e-55af-4871-817d-acf34c87a2de None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.828127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c550e-55af-4871-817d-acf34c87a2de None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.828507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c550e-55af-4871-817d-acf34c87a2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.847015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8a3c550e-55af-4871-817d-acf34c87a2de None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:02.848338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8a3c550e-55af-4871-817d-acf34c87a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:02.915787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 981/1968] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:02.921081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf29b5-09c2-479f-91eb-86cf5387637b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.921406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf29b5-09c2-479f-91eb-86cf5387637b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.921816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf29b5-09c2-479f-91eb-86cf5387637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.935180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c550e-55af-4871-817d-acf34c87a2de None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:02.939346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8a3c550e-55af-4871-817d-acf34c87a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:02.944096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-50cf29b5-09c2-479f-91eb-86cf5387637b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:02.945358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-50cf29b5-09c2-479f-91eb-86cf5387637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:02.951467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c550e-55af-4871-817d-acf34c87a2de None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:02.958139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 988/1969] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:02.959259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:02.960319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.960769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.961257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] PATH_INFO: `/v3/projects/2de201c7aac9481ea57219faaeba86c9` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.962423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf29b5-09c2-479f-91eb-86cf5387637b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:02.963045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de201c7aac9481ea57219faaeba86c9)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:02.972307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf29b5-09c2-479f-91eb-86cf5387637b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:02.972534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:02.976769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:02.977426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:02.977704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:02.977975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:02.978693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:02.978990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:02.981243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:02.993574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 989/1970] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:38:02.998294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.007533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50ffa-1ed1-4b55-94c0-3dc49d009e2c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.012148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3ffca-f0d4-477c-9132-408d250c2d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.012797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ffca-f0d4-477c-9132-408d250c2d85 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.013079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ffca-f0d4-477c-9132-408d250c2d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.013388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ffca-f0d4-477c-9132-408d250c2d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.014083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3ffca-f0d4-477c-9132-408d250c2d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.016000 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3ffca-f0d4-477c-9132-408d250c2d85 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.024473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de201c7aac9481ea57219faaeba86c9', 'request_id': 'req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:03.031127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de201c7aac9481ea57219faaeba86c9', 'request_id': 'req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:03.038582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de201c7aac9481ea57219faaeba86c9', 'request_id': 'req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:03.044123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 990/1971] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:02 2021] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:03.048436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3ffca-f0d4-477c-9132-408d250c2d85 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.049826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] The token cache is being invalidate because project 2de201c7aac9481ea57219faaeba86c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:03.050211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:03.050794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7dba0ee5-a21e-4656-9eb4-2bc0578cb465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:03.057013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 982/1972] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:02 2021] DELETE /identity/v3/projects/2de201c7aac9481ea57219faaeba86c9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:03.060080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6111f2-b556-4c6e-a42e-ad109368d505 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.060356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6111f2-b556-4c6e-a42e-ad109368d505 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.060638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6111f2-b556-4c6e-a42e-ad109368d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.078349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8f6111f2-b556-4c6e-a42e-ad109368d505 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:03.079532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8f6111f2-b556-4c6e-a42e-ad109368d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:03.115503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3ffca-f0d4-477c-9132-408d250c2d85 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.123946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.124697 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.124980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.125253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.125955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.128344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.147131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 983/1973] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:03.154898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fbf62-0b6b-4f3f-885a-aa5b54a60da1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.155190 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fbf62-0b6b-4f3f-885a-aa5b54a60da1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.155471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fbf62-0b6b-4f3f-885a-aa5b54a60da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.156463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 991/1974] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:03.159791 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.161435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:03.177071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8742aa-d193-485f-87b8-c5a2fd11309f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.177696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fe7fbf62-0b6b-4f3f-885a-aa5b54a60da1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:03.179037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fe7fbf62-0b6b-4f3f-885a-aa5b54a60da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:03.182012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c58f5-7437-40d8-afe2-15049f313832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.182773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c58f5-7437-40d8-afe2-15049f313832 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.182961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c58f5-7437-40d8-afe2-15049f313832 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.183866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c58f5-7437-40d8-afe2-15049f313832 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.184737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c58f5-7437-40d8-afe2-15049f313832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.186371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c58f5-7437-40d8-afe2-15049f313832 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.191574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 984/1975] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:03.193131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fbf62-0b6b-4f3f-885a-aa5b54a60da1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.203792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 992/1976] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:03.203963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fbf62-0b6b-4f3f-885a-aa5b54a60da1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.204636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c58f5-7437-40d8-afe2-15049f313832 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.208755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.209496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.209843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.210184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.211066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:03.211367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.213024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.214713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c58f5-7437-40d8-afe2-15049f313832 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.220198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208dd8-b956-490f-93d9-d5a9f8f0e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.220946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208dd8-b956-490f-93d9-d5a9f8f0e230 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.221300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208dd8-b956-490f-93d9-d5a9f8f0e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.221644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208dd8-b956-490f-93d9-d5a9f8f0e230 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.222551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7208dd8-b956-490f-93d9-d5a9f8f0e230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.224306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7208dd8-b956-490f-93d9-d5a9f8f0e230 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.235406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 993/1977] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:03.241213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 985/1978] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:38:03.241360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208dd8-b956-490f-93d9-d5a9f8f0e230 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.242308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.250860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208dd8-b956-490f-93d9-d5a9f8f0e230 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.252527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9cc07-64fb-479d-ad69-485ae73e4cd2 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.255525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227880b9-fa97-4d2b-883a-095fccce67c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.256527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227880b9-fa97-4d2b-883a-095fccce67c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.256885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227880b9-fa97-4d2b-883a-095fccce67c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.257236 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227880b9-fa97-4d2b-883a-095fccce67c8 admin admin] PATH_INFO: `/v3/projects/cfb0766c780144d2b4e53268c17fb86a/users/f3f51b7c154849beae5848193ee3628b/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.258300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854e5b8-b555-4983-a656-1b280be730e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.259025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e5b8-b555-4983-a656-1b280be730e6 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.259380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e5b8-b555-4983-a656-1b280be730e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.259904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e5b8-b555-4983-a656-1b280be730e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.260666 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e5b8-b555-4983-a656-1b280be730e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.262681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e5b8-b555-4983-a656-1b280be730e6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.272647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227880b9-fa97-4d2b-883a-095fccce67c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb0766c780144d2b4e53268c17fb86a, user_id=f3f51b7c154849beae5848193ee3628b, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.275432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227880b9-fa97-4d2b-883a-095fccce67c8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.293956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 994/1979] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:03 2021] PUT /identity/v3/projects/cfb0766c780144d2b4e53268c17fb86a/users/f3f51b7c154849beae5848193ee3628b/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:03.305300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99843-b910-4171-91cf-f9ffe59f2e14 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.305608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99843-b910-4171-91cf-f9ffe59f2e14 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.306334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99843-b910-4171-91cf-f9ffe59f2e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.311234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 986/1980] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:03.316143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854e5b8-b555-4983-a656-1b280be730e6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.338226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d4e99843-b910-4171-91cf-f9ffe59f2e14 None None] MFA Rules not processed for user `f3f51b7c154849beae5848193ee3628b`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:03.339476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d4e99843-b910-4171-91cf-f9ffe59f2e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:03.406542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854e5b8-b555-4983-a656-1b280be730e6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.412435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092fd19-c55f-4b22-806d-a1165d778b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.413259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092fd19-c55f-4b22-806d-a1165d778b2c admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.413624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092fd19-c55f-4b22-806d-a1165d778b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.413999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092fd19-c55f-4b22-806d-a1165d778b2c admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.414786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092fd19-c55f-4b22-806d-a1165d778b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.419356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 995/1981] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:03.419526 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092fd19-c55f-4b22-806d-a1165d778b2c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.420784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e99843-b910-4171-91cf-f9ffe59f2e14 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.433671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e99843-b910-4171-91cf-f9ffe59f2e14 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.438458 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411c2a5-333f-4a4f-9d9c-b922165eed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.439230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411c2a5-333f-4a4f-9d9c-b922165eed9e admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.439518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411c2a5-333f-4a4f-9d9c-b922165eed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.439890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411c2a5-333f-4a4f-9d9c-b922165eed9e admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.440548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411c2a5-333f-4a4f-9d9c-b922165eed9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.441558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 987/1982] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:03.442653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411c2a5-333f-4a4f-9d9c-b922165eed9e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.445678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092fd19-c55f-4b22-806d-a1165d778b2c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.455833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092fd19-c55f-4b22-806d-a1165d778b2c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.462213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82723b-d261-4160-9c50-6144eefa6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.462883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82723b-d261-4160-9c50-6144eefa6fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.463169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82723b-d261-4160-9c50-6144eefa6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.463446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82723b-d261-4160-9c50-6144eefa6fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.464277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82723b-d261-4160-9c50-6144eefa6fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.465882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82723b-d261-4160-9c50-6144eefa6fa8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.476548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 988/1983] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:03.480923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82723b-d261-4160-9c50-6144eefa6fa8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.490351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82723b-d261-4160-9c50-6144eefa6fa8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.493161 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 996/1984] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:03.497587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411c2a5-333f-4a4f-9d9c-b922165eed9e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.554737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e488940-073c-443d-8ffc-374c3180b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.555416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e488940-073c-443d-8ffc-374c3180b8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.555733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e488940-073c-443d-8ffc-374c3180b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.556013 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e488940-073c-443d-8ffc-374c3180b8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.556731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e488940-073c-443d-8ffc-374c3180b8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.559054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e488940-073c-443d-8ffc-374c3180b8f6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.564184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411c2a5-333f-4a4f-9d9c-b922165eed9e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.568544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81225f1-4b35-480b-8bc9-01db8c1ce2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.572188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 989/1985] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:03.572333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81225f1-4b35-480b-8bc9-01db8c1ce2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.572333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81225f1-4b35-480b-8bc9-01db8c1ce2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.572333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81225f1-4b35-480b-8bc9-01db8c1ce2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.572333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81225f1-4b35-480b-8bc9-01db8c1ce2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.572333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81225f1-4b35-480b-8bc9-01db8c1ce2d1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.573615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e488940-073c-443d-8ffc-374c3180b8f6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.582767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e488940-073c-443d-8ffc-374c3180b8f6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.588017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9da31b-75de-46df-ad46-3b10f3798683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.589063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9da31b-75de-46df-ad46-3b10f3798683 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.589366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9da31b-75de-46df-ad46-3b10f3798683 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.589653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9da31b-75de-46df-ad46-3b10f3798683 admin admin] PATH_INFO: `/v3/projects/ff4c1ea93dce4de281d3767f1e980f95/users/af143d9bc74c4d8ba5ecd3b4bba2418a/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.593101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 997/1986] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:03.596628 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81225f1-4b35-480b-8bc9-01db8c1ce2d1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.605106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9da31b-75de-46df-ad46-3b10f3798683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4c1ea93dce4de281d3767f1e980f95, user_id=af143d9bc74c4d8ba5ecd3b4bba2418a, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.605900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81225f1-4b35-480b-8bc9-01db8c1ce2d1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.607941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9da31b-75de-46df-ad46-3b10f3798683 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.610303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a667af-36bc-4ba7-88c7-847570d290c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.610960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a667af-36bc-4ba7-88c7-847570d290c5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.611227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a667af-36bc-4ba7-88c7-847570d290c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.611496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a667af-36bc-4ba7-88c7-847570d290c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.612323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a667af-36bc-4ba7-88c7-847570d290c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.614299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a667af-36bc-4ba7-88c7-847570d290c5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.621364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 990/1987] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:03 2021] PUT /identity/v3/projects/ff4c1ea93dce4de281d3767f1e980f95/users/af143d9bc74c4d8ba5ecd3b4bba2418a/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:03.624820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 998/1988] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:03.628599 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9da31b-75de-46df-ad46-3b10f3798683 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.631628 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d206e-4e7d-4ace-9b84-ff63a4fd9349 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.631954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d206e-4e7d-4ace-9b84-ff63a4fd9349 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.632257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d206e-4e7d-4ace-9b84-ff63a4fd9349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.658233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-dc2d206e-4e7d-4ace-9b84-ff63a4fd9349 None None] MFA Rules not processed for user `af143d9bc74c4d8ba5ecd3b4bba2418a`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:03.660312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-dc2d206e-4e7d-4ace-9b84-ff63a4fd9349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:03.695043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9da31b-75de-46df-ad46-3b10f3798683 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.707939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ed2a-8dfb-415d-ac41-d21511417cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.708714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ed2a-8dfb-415d-ac41-d21511417cce admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.709007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ed2a-8dfb-415d-ac41-d21511417cce admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.709442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ed2a-8dfb-415d-ac41-d21511417cce admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.710642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576ed2a-8dfb-415d-ac41-d21511417cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.712985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576ed2a-8dfb-415d-ac41-d21511417cce admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.728354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 991/1989] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:03.732063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ed2a-8dfb-415d-ac41-d21511417cce admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.739888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 999/1990] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:03.741367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ed2a-8dfb-415d-ac41-d21511417cce admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.744320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d206e-4e7d-4ace-9b84-ff63a4fd9349 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.746287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490a96-9685-47d6-83ee-0c258d70f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.747173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490a96-9685-47d6-83ee-0c258d70f114 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.747461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490a96-9685-47d6-83ee-0c258d70f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.747766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490a96-9685-47d6-83ee-0c258d70f114 admin admin] PATH_INFO: `/v3/projects/825538c619054605bfc8fdeb75d1c959/users/4d5483e0cc784930aad8eba4b2af1b08/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.754277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d206e-4e7d-4ace-9b84-ff63a4fd9349 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.758661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fdad2-bb50-4c39-b322-7ffdd83587eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.759316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdad2-bb50-4c39-b322-7ffdd83587eb admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.759621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdad2-bb50-4c39-b322-7ffdd83587eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.759944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdad2-bb50-4c39-b322-7ffdd83587eb admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.760641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fdad2-bb50-4c39-b322-7ffdd83587eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.762844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fdad2-bb50-4c39-b322-7ffdd83587eb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.764339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490a96-9685-47d6-83ee-0c258d70f114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=825538c619054605bfc8fdeb75d1c959, user_id=4d5483e0cc784930aad8eba4b2af1b08, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.768092 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490a96-9685-47d6-83ee-0c258d70f114 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.783185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 992/1991] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:03 2021] PUT /identity/v3/projects/825538c619054605bfc8fdeb75d1c959/users/4d5483e0cc784930aad8eba4b2af1b08/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:03.790874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1000/1992] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:03.794308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2808-763b-46bd-9033-7fa75d744860 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.795023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fdad2-bb50-4c39-b322-7ffdd83587eb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.795189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2808-763b-46bd-9033-7fa75d744860 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.795627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2808-763b-46bd-9033-7fa75d744860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.823804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-583d2808-763b-46bd-9033-7fa75d744860 None None] MFA Rules not processed for user `4d5483e0cc784930aad8eba4b2af1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:03.827210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-583d2808-763b-46bd-9033-7fa75d744860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:03.858482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fdad2-bb50-4c39-b322-7ffdd83587eb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.863213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf873efa-e6a4-4838-82fa-af4591095372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.863983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf873efa-e6a4-4838-82fa-af4591095372 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.864511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf873efa-e6a4-4838-82fa-af4591095372 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.864690 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf873efa-e6a4-4838-82fa-af4591095372 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.865375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf873efa-e6a4-4838-82fa-af4591095372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.867285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf873efa-e6a4-4838-82fa-af4591095372 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.890761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1001/1993] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:03.892296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 993/1994] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:03.896790 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf873efa-e6a4-4838-82fa-af4591095372 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.897285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d2808-763b-46bd-9033-7fa75d744860 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.908285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf873efa-e6a4-4838-82fa-af4591095372 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.908915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d2808-763b-46bd-9033-7fa75d744860 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.913836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6419f-65b1-4cb0-8af2-0620c40f8177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.914658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6419f-65b1-4cb0-8af2-0620c40f8177 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.914946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6419f-65b1-4cb0-8af2-0620c40f8177 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.915223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6419f-65b1-4cb0-8af2-0620c40f8177 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.915979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6419f-65b1-4cb0-8af2-0620c40f8177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.916660 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406253be-7c82-4a23-b9dc-4167cb507ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.918007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406253be-7c82-4a23-b9dc-4167cb507ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.918299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406253be-7c82-4a23-b9dc-4167cb507ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.918846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6419f-65b1-4cb0-8af2-0620c40f8177 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.918933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406253be-7c82-4a23-b9dc-4167cb507ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.919337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406253be-7c82-4a23-b9dc-4167cb507ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.921216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406253be-7c82-4a23-b9dc-4167cb507ec9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.932719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1002/1995] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:03.936612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6419f-65b1-4cb0-8af2-0620c40f8177 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.947449 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6419f-65b1-4cb0-8af2-0620c40f8177 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:03.953134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a09dc4-4adc-458f-926c-55c9b82d0bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:03.956818 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09dc4-4adc-458f-926c-55c9b82d0bde admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:03.957107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 994/1996] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:03.957523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09dc4-4adc-458f-926c-55c9b82d0bde admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:03.957523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09dc4-4adc-458f-926c-55c9b82d0bde admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:03.957523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a09dc4-4adc-458f-926c-55c9b82d0bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:03.957523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a09dc4-4adc-458f-926c-55c9b82d0bde admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:03.958774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406253be-7c82-4a23-b9dc-4167cb507ec9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.973946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1003/1997] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:03.974980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a09dc4-4adc-458f-926c-55c9b82d0bde admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:03.984951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a09dc4-4adc-458f-926c-55c9b82d0bde admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.031133 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406253be-7c82-4a23-b9dc-4167cb507ec9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.035994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532aff1-40f8-4fc7-9759-fb1f5d2f8ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.036666 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532aff1-40f8-4fc7-9759-fb1f5d2f8ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.036945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532aff1-40f8-4fc7-9759-fb1f5d2f8ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.037221 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532aff1-40f8-4fc7-9759-fb1f5d2f8ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.037931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532aff1-40f8-4fc7-9759-fb1f5d2f8ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.038754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3503df5-d5bd-4651-ad35-b24fa7ed9ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.039641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503df5-d5bd-4651-ad35-b24fa7ed9ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.039894 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532aff1-40f8-4fc7-9759-fb1f5d2f8ab1 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.039988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503df5-d5bd-4651-ad35-b24fa7ed9ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.040242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503df5-d5bd-4651-ad35-b24fa7ed9ef2 admin admin] PATH_INFO: `/v3/projects/510ac9fb0af94a86945ce568629ed77c/users/e4c174b587924702bbe6c1e1248ee7f9/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.055452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3503df5-d5bd-4651-ad35-b24fa7ed9ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510ac9fb0af94a86945ce568629ed77c, user_id=e4c174b587924702bbe6c1e1248ee7f9, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.058206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3503df5-d5bd-4651-ad35-b24fa7ed9ef2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.060373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 995/1998] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:03 2021] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:04.064615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532aff1-40f8-4fc7-9759-fb1f5d2f8ab1 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.072132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1004/1999] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:03 2021] PUT /identity/v3/projects/510ac9fb0af94a86945ce568629ed77c/users/e4c174b587924702bbe6c1e1248ee7f9/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:04.074478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532aff1-40f8-4fc7-9759-fb1f5d2f8ab1 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.083857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56793bc-025b-4281-9c42-7ed52e6feb0d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.084148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56793bc-025b-4281-9c42-7ed52e6feb0d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.084551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56793bc-025b-4281-9c42-7ed52e6feb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.113070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b56793bc-025b-4281-9c42-7ed52e6feb0d None None] MFA Rules not processed for user `e4c174b587924702bbe6c1e1248ee7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:04.114158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b56793bc-025b-4281-9c42-7ed52e6feb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:04.133116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4bd21-06d1-4190-9a21-595c469c010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.133795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4bd21-06d1-4190-9a21-595c469c010b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.134077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4bd21-06d1-4190-9a21-595c469c010b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.134360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4bd21-06d1-4190-9a21-595c469c010b admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.135087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4bd21-06d1-4190-9a21-595c469c010b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.136784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4bd21-06d1-4190-9a21-595c469c010b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.147370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 996/2000] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:04 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:04.151582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4bd21-06d1-4190-9a21-595c469c010b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.161456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4bd21-06d1-4190-9a21-595c469c010b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.166369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd5a47-4033-4b87-8630-f6677b0d136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.168322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd5a47-4033-4b87-8630-f6677b0d136a admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.168553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd5a47-4033-4b87-8630-f6677b0d136a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.168833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd5a47-4033-4b87-8630-f6677b0d136a admin admin] PATH_INFO: `/v3/projects/788f3cd3087d4f73b7bbcdb3afad967f/users/0a8b83a56b104b76851af46d8cb81bdf/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.176585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1005/2001] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:04 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:04.180930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56793bc-025b-4281-9c42-7ed52e6feb0d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.185971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd5a47-4033-4b87-8630-f6677b0d136a admin admin] RBAC: Authorizing `identity:create_grant(project_id=788f3cd3087d4f73b7bbcdb3afad967f, user_id=0a8b83a56b104b76851af46d8cb81bdf, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.188704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd5a47-4033-4b87-8630-f6677b0d136a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.190989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56793bc-025b-4281-9c42-7ed52e6feb0d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.195954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e30c-cef4-46cd-a123-5f0b4f0bb19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.196717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e30c-cef4-46cd-a123-5f0b4f0bb19d admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.197008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e30c-cef4-46cd-a123-5f0b4f0bb19d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.197286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e30c-cef4-46cd-a123-5f0b4f0bb19d admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.197977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953e30c-cef4-46cd-a123-5f0b4f0bb19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.199988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953e30c-cef4-46cd-a123-5f0b4f0bb19d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.201519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 997/2002] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:04 2021] PUT /identity/v3/projects/788f3cd3087d4f73b7bbcdb3afad967f/users/0a8b83a56b104b76851af46d8cb81bdf/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:04.205389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd5a47-4033-4b87-8630-f6677b0d136a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.228304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1006/2003] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:04 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:04.229294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e30c-cef4-46cd-a123-5f0b4f0bb19d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.272891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd5a47-4033-4b87-8630-f6677b0d136a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.290037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e30c-cef4-46cd-a123-5f0b4f0bb19d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.294517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2928462-dbae-463f-9d98-973ce2430e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.295208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928462-dbae-463f-9d98-973ce2430e01 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.297443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928462-dbae-463f-9d98-973ce2430e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.297443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928462-dbae-463f-9d98-973ce2430e01 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.297443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2928462-dbae-463f-9d98-973ce2430e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.298391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2928462-dbae-463f-9d98-973ce2430e01 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.321557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1007/2004] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:04 2021] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:04.325955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2928462-dbae-463f-9d98-973ce2430e01 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.335177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2928462-dbae-463f-9d98-973ce2430e01 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.337192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f4c1-c39c-4d65-89af-795670dfea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.337898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f4c1-c39c-4d65-89af-795670dfea7f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.338155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f4c1-c39c-4d65-89af-795670dfea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.338436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f4c1-c39c-4d65-89af-795670dfea7f admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.339827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f4c1-c39c-4d65-89af-795670dfea7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.340701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f35a8-84e7-40ac-bb8b-5d3eb3107500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.341507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f35a8-84e7-40ac-bb8b-5d3eb3107500 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.341617 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f4c1-c39c-4d65-89af-795670dfea7f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.341845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f35a8-84e7-40ac-bb8b-5d3eb3107500 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.342130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f35a8-84e7-40ac-bb8b-5d3eb3107500 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.342907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f35a8-84e7-40ac-bb8b-5d3eb3107500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.344832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f35a8-84e7-40ac-bb8b-5d3eb3107500 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.352132 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 998/2005] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:04 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:04.355638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1008/2006] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:04.359655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f35a8-84e7-40ac-bb8b-5d3eb3107500 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.359792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f4c1-c39c-4d65-89af-795670dfea7f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.369969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f35a8-84e7-40ac-bb8b-5d3eb3107500 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.370395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f4c1-c39c-4d65-89af-795670dfea7f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.374711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f4e00-317d-40b8-a919-63f01e2affca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.374896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495798a-d490-4a9c-999c-ab705dc48458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.375593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f4e00-317d-40b8-a919-63f01e2affca admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.375777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495798a-d490-4a9c-999c-ab705dc48458 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.375915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f4e00-317d-40b8-a919-63f01e2affca admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.376068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495798a-d490-4a9c-999c-ab705dc48458 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.376159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f4e00-317d-40b8-a919-63f01e2affca admin admin] PATH_INFO: `/v3/projects/5867b593f6a04a0c939aab5f644f2861/users/03dbaa3a55dd42b68098e06139b6bcd9/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.376345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495798a-d490-4a9c-999c-ab705dc48458 admin admin] PATH_INFO: `/v3/projects/788f3cd3087d4f73b7bbcdb3afad967f/users/0a8b83a56b104b76851af46d8cb81bdf/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.378519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495798a-d490-4a9c-999c-ab705dc48458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788f3cd3087d4f73b7bbcdb3afad967f, user_id=0a8b83a56b104b76851af46d8cb81bdf, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.381386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495798a-d490-4a9c-999c-ab705dc48458 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.392557 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 999/2007] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:04 2021] PUT /identity/v3/projects/788f3cd3087d4f73b7bbcdb3afad967f/users/0a8b83a56b104b76851af46d8cb81bdf/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:04.395808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f4e00-317d-40b8-a919-63f01e2affca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5867b593f6a04a0c939aab5f644f2861, user_id=03dbaa3a55dd42b68098e06139b6bcd9, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.396670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f4e00-317d-40b8-a919-63f01e2affca admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.403252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631c5d-ffb3-4ad1-95a1-1b2da9fb9d4c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.403498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631c5d-ffb3-4ad1-95a1-1b2da9fb9d4c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.404040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631c5d-ffb3-4ad1-95a1-1b2da9fb9d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.412944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1009/2008] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:04 2021] PUT /identity/v3/projects/5867b593f6a04a0c939aab5f644f2861/users/03dbaa3a55dd42b68098e06139b6bcd9/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:04.416674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f4e00-317d-40b8-a919-63f01e2affca admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.432561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8f631c5d-ffb3-4ad1-95a1-1b2da9fb9d4c None None] MFA Rules not processed for user `0a8b83a56b104b76851af46d8cb81bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:04.433845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8f631c5d-ffb3-4ad1-95a1-1b2da9fb9d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:04.476102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f4e00-317d-40b8-a919-63f01e2affca admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.480951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefd37d-9996-4e6b-8e75-de2c5b87b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.481736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd37d-9996-4e6b-8e75-de2c5b87b627 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.482024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd37d-9996-4e6b-8e75-de2c5b87b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.482305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd37d-9996-4e6b-8e75-de2c5b87b627 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.483054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefd37d-9996-4e6b-8e75-de2c5b87b627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.484691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefd37d-9996-4e6b-8e75-de2c5b87b627 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.494411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1010/2009] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:04 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:04.499053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefd37d-9996-4e6b-8e75-de2c5b87b627 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.501676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1000/2010] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:04 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:04.508250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefd37d-9996-4e6b-8e75-de2c5b87b627 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.511888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f631c5d-ffb3-4ad1-95a1-1b2da9fb9d4c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.513172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8f631c5d-ffb3-4ad1-95a1-1b2da9fb9d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:04.513401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba842954-44a4-464b-a23e-e09ba5a501ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.514281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842954-44a4-464b-a23e-e09ba5a501ee admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.514570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842954-44a4-464b-a23e-e09ba5a501ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.514848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842954-44a4-464b-a23e-e09ba5a501ee admin admin] PATH_INFO: `/v3/projects/5867b593f6a04a0c939aab5f644f2861/users/03dbaa3a55dd42b68098e06139b6bcd9/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.516738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba842954-44a4-464b-a23e-e09ba5a501ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5867b593f6a04a0c939aab5f644f2861, user_id=03dbaa3a55dd42b68098e06139b6bcd9, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.519363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba842954-44a4-464b-a23e-e09ba5a501ee admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.529625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1011/2011] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:04 2021] PUT /identity/v3/projects/5867b593f6a04a0c939aab5f644f2861/users/03dbaa3a55dd42b68098e06139b6bcd9/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:04.539422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f8cf2-1517-46c9-b4d4-ff83b3dad03b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.539732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f8cf2-1517-46c9-b4d4-ff83b3dad03b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.540031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f8cf2-1517-46c9-b4d4-ff83b3dad03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.568725 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f631c5d-ffb3-4ad1-95a1-1b2da9fb9d4c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.570447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-a63f8cf2-1517-46c9-b4d4-ff83b3dad03b None None] MFA Rules not processed for user `03dbaa3a55dd42b68098e06139b6bcd9`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:04.571644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a63f8cf2-1517-46c9-b4d4-ff83b3dad03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:04.616091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabddde-488f-4c84-9714-e7c9e55f2a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.616743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabddde-488f-4c84-9714-e7c9e55f2a23 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.617022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabddde-488f-4c84-9714-e7c9e55f2a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.617301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabddde-488f-4c84-9714-e7c9e55f2a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.636559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1012/2012] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:04 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:04.647007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f8cf2-1517-46c9-b4d4-ff83b3dad03b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:04.648328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a63f8cf2-1517-46c9-b4d4-ff83b3dad03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:04.659282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f8cf2-1517-46c9-b4d4-ff83b3dad03b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:04.662726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0585-e28b-4569-a253-34bdcbf45a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:04.663363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0585-e28b-4569-a253-34bdcbf45a4d service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:04.663646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0585-e28b-4569-a253-34bdcbf45a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:04.663961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0585-e28b-4569-a253-34bdcbf45a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:04.679074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabddde-488f-4c84-9714-e7c9e55f2a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.680568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabddde-488f-4c84-9714-e7c9e55f2a23 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.690172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1001/2013] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:04 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:04.718164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0585-e28b-4569-a253-34bdcbf45a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:04.719906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0585-e28b-4569-a253-34bdcbf45a4d service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:04.728328 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1013/2014] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:04 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:38:05.233457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabddde-488f-4c84-9714-e7c9e55f2a23 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:05.241357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabddde-488f-4c84-9714-e7c9e55f2a23 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:05.244819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a0088-2b5b-4ac4-94db-196aea4d3067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:05.245658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0088-2b5b-4ac4-94db-196aea4d3067 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:05.245943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0088-2b5b-4ac4-94db-196aea4d3067 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:05.246219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0088-2b5b-4ac4-94db-196aea4d3067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:05.300431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a0088-2b5b-4ac4-94db-196aea4d3067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:05.301868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a0088-2b5b-4ac4-94db-196aea4d3067 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:05.310197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1002/2015] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:05 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:08.419065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0585-e28b-4569-a253-34bdcbf45a4d service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:08.428556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0585-e28b-4569-a253-34bdcbf45a4d service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:08.432181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107c580-a8e0-4615-a5c7-d60461254655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:08.434231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c580-a8e0-4615-a5c7-d60461254655 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:08.434231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c580-a8e0-4615-a5c7-d60461254655 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:08.434231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c580-a8e0-4615-a5c7-d60461254655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:08.492446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107c580-a8e0-4615-a5c7-d60461254655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:08.493881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107c580-a8e0-4615-a5c7-d60461254655 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:08.502750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1014/2016] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:08 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:09.093322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a0088-2b5b-4ac4-94db-196aea4d3067 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:09.102734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a0088-2b5b-4ac4-94db-196aea4d3067 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:09.106615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2de5-e1b4-4991-b148-026e74e572d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:09.107250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2de5-e1b4-4991-b148-026e74e572d1 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:09.107528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2de5-e1b4-4991-b148-026e74e572d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:09.107832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2de5-e1b4-4991-b148-026e74e572d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:09.116347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2de5-e1b4-4991-b148-026e74e572d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:09.117768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2de5-e1b4-4991-b148-026e74e572d1 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:09.127266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1003/2017] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:09 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:15.750075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107c580-a8e0-4615-a5c7-d60461254655 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:15.761679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107c580-a8e0-4615-a5c7-d60461254655 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:15.765962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c82c5-0539-43a1-807b-d47fc9358b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:15.766651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c82c5-0539-43a1-807b-d47fc9358b41 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:15.766934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c82c5-0539-43a1-807b-d47fc9358b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:15.767210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c82c5-0539-43a1-807b-d47fc9358b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:15.831794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c82c5-0539-43a1-807b-d47fc9358b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:15.833238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c82c5-0539-43a1-807b-d47fc9358b41 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:15.842510 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1015/2018] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:15 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:31.203949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217053-d532-4e09-a66a-54d3a51ecb16 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:31.204468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217053-d532-4e09-a66a-54d3a51ecb16 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:31.205151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217053-d532-4e09-a66a-54d3a51ecb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:31.231305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-30217053-d532-4e09-a66a-54d3a51ecb16 None None] MFA Rules not processed for user `f3ecf43d42c74783a82bf45afd8826e8`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:31.232693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-30217053-d532-4e09-a66a-54d3a51ecb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:31.305893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1004/2019] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:31 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:31.384355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c82c5-0539-43a1-807b-d47fc9358b41 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:31.462682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c82c5-0539-43a1-807b-d47fc9358b41 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:31.470310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:31.471319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:31.471671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:31.472042 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] PATH_INFO: `/v3/users/af143d9bc74c4d8ba5ecd3b4bba2418a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:31.473547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af143d9bc74c4d8ba5ecd3b4bba2418a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:31.476919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:31.547981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af143d9bc74c4d8ba5ecd3b4bba2418a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:31.567846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af143d9bc74c4d8ba5ecd3b4bba2418a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:31.578163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af143d9bc74c4d8ba5ecd3b4bba2418a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:31.581553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af143d9bc74c4d8ba5ecd3b4bba2418a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:31.591904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af143d9bc74c4d8ba5ecd3b4bba2418a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:31.614587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1016/2020] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:31 2021] DELETE /identity/v3/users/af143d9bc74c4d8ba5ecd3b4bba2418a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:31.619181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eebac-93c8-410c-991d-f2705464b436 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:31.619477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eebac-93c8-410c-991d-f2705464b436 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:31.620051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eebac-93c8-410c-991d-f2705464b436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:31.646095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6f0eebac-93c8-410c-991d-f2705464b436 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:31.647942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6f0eebac-93c8-410c-991d-f2705464b436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:31.763337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1005/2021] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:31.774992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:31.776436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:31.861275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de46496-3f22-4af4-bd78-92ffd3cd9d81 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:31.867139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da250c6-6af2-4b00-a090-24a5aab0853d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:31.867854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da250c6-6af2-4b00-a090-24a5aab0853d service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:31.868138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da250c6-6af2-4b00-a090-24a5aab0853d service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:31.868417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da250c6-6af2-4b00-a090-24a5aab0853d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:31.886083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da250c6-6af2-4b00-a090-24a5aab0853d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:31.888942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da250c6-6af2-4b00-a090-24a5aab0853d service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:31.903046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1017/2022] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:31.996801 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0eebac-93c8-410c-991d-f2705464b436 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:31.998199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6f0eebac-93c8-410c-991d-f2705464b436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:32.017298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0eebac-93c8-410c-991d-f2705464b436 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:32.027042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:32.029359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:32.029808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:32.030417 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] PATH_INFO: `/v3/users/f3f51b7c154849beae5848193ee3628b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:32.033122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f51b7c154849beae5848193ee3628b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:32.036072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:32.144842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f51b7c154849beae5848193ee3628b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.160857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f51b7c154849beae5848193ee3628b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.161792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f51b7c154849beae5848193ee3628b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.177411 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f51b7c154849beae5848193ee3628b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.178331 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f51b7c154849beae5848193ee3628b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.193030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1006/2023] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:31 2021] DELETE /identity/v3/users/f3f51b7c154849beae5848193ee3628b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:32.197910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5d5c6-3d30-4f26-a9bc-09085432bc09 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:32.198550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5d5c6-3d30-4f26-a9bc-09085432bc09 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:32.199085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5d5c6-3d30-4f26-a9bc-09085432bc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:32.222021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-bfa5d5c6-3d30-4f26-a9bc-09085432bc09 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:32.223677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bfa5d5c6-3d30-4f26-a9bc-09085432bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:32.300122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1018/2024] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:32.311228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:32.313674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:32.331558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5d5c6-3d30-4f26-a9bc-09085432bc09 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:32.334128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bfa5d5c6-3d30-4f26-a9bc-09085432bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:32.363398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5d5c6-3d30-4f26-a9bc-09085432bc09 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:32.369715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:32.370666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:32.370955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:32.371233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] PATH_INFO: `/v3/projects/ff4c1ea93dce4de281d3767f1e980f95` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:32.372891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4c1ea93dce4de281d3767f1e980f95)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:32.377441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:32.379869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204b05c-977e-4ea9-9ebd-392b05ca808b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:32.383675 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcb809-5b01-4fb9-8ba7-28265a8c43db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:32.384357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcb809-5b01-4fb9-8ba7-28265a8c43db service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:32.384641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcb809-5b01-4fb9-8ba7-28265a8c43db service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:32.384922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcb809-5b01-4fb9-8ba7-28265a8c43db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:32.394650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcb809-5b01-4fb9-8ba7-28265a8c43db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:32.396142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcb809-5b01-4fb9-8ba7-28265a8c43db service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:32.406658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1007/2025] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:32.428649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4c1ea93dce4de281d3767f1e980f95', 'request_id': 'req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.436502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4c1ea93dce4de281d3767f1e980f95', 'request_id': 'req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.445782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4c1ea93dce4de281d3767f1e980f95', 'request_id': 'req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.459308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] The token cache is being invalidate because project ff4c1ea93dce4de281d3767f1e980f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:32.459666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.460431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.464063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1019/2026] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:32 2021] DELETE /identity/v3/projects/ff4c1ea93dce4de281d3767f1e980f95 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:32.468303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcb809-5b01-4fb9-8ba7-28265a8c43db service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:32.478414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcb809-5b01-4fb9-8ba7-28265a8c43db service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:32.543068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:32.543980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:32.544325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:32.544605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] PATH_INFO: `/v3/users/e4c174b587924702bbe6c1e1248ee7f9` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:32.545943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c174b587924702bbe6c1e1248ee7f9)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:32.547937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:32.605725 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c174b587924702bbe6c1e1248ee7f9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.617687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c174b587924702bbe6c1e1248ee7f9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.618328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c174b587924702bbe6c1e1248ee7f9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.626464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c174b587924702bbe6c1e1248ee7f9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.627195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c174b587924702bbe6c1e1248ee7f9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.639405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1008/2027] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:32 2021] DELETE /identity/v3/users/e4c174b587924702bbe6c1e1248ee7f9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:32.730779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:32.732608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:32.771123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00ec4e-6f37-4e6a-a5fc-c9e2da0437bb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:32.873144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:32.873144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:32.873144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:32.873144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] PATH_INFO: `/v3/projects/cfb0766c780144d2b4e53268c17fb86a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:32.874750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb0766c780144d2b4e53268c17fb86a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:32.876719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:32.937964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb0766c780144d2b4e53268c17fb86a', 'request_id': 'req-e75d380c-d7e0-4a46-836e-3fb065d10d15'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.944931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb0766c780144d2b4e53268c17fb86a', 'request_id': 'req-e75d380c-d7e0-4a46-836e-3fb065d10d15'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.957006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb0766c780144d2b4e53268c17fb86a', 'request_id': 'req-e75d380c-d7e0-4a46-836e-3fb065d10d15'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.972678 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] The token cache is being invalidate because project cfb0766c780144d2b4e53268c17fb86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:32.972995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.974519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:32.977366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1020/2028] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:32 2021] DELETE /identity/v3/projects/cfb0766c780144d2b4e53268c17fb86a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:32.981652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:32.983114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:33.006198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216ab4-e160-4878-b16a-e409b357b612 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:33.027772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:33.037442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:33.078817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:33.079686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:33.080020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:33.080302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] PATH_INFO: `/v3/users/4d5483e0cc784930aad8eba4b2af1b08` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:33.081459 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5483e0cc784930aad8eba4b2af1b08)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:33.083385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:33.108070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d380c-d7e0-4a46-836e-3fb065d10d15 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:33.113722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:33.115060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:33.115386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:33.115851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] PATH_INFO: `/v3/projects/510ac9fb0af94a86945ce568629ed77c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:33.117764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510ac9fb0af94a86945ce568629ed77c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:33.120840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:33.135986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5483e0cc784930aad8eba4b2af1b08'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.150447 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5483e0cc784930aad8eba4b2af1b08'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.151211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5483e0cc784930aad8eba4b2af1b08'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.160249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5483e0cc784930aad8eba4b2af1b08'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.161196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5483e0cc784930aad8eba4b2af1b08'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.174823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1009/2029] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:32 2021] DELETE /identity/v3/users/4d5483e0cc784930aad8eba4b2af1b08 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:33.183117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510ac9fb0af94a86945ce568629ed77c', 'request_id': 'req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.190676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510ac9fb0af94a86945ce568629ed77c', 'request_id': 'req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.204164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510ac9fb0af94a86945ce568629ed77c', 'request_id': 'req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.232376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] The token cache is being invalidate because project 510ac9fb0af94a86945ce568629ed77c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:33.234297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.234297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.238669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1021/2030] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:33 2021] DELETE /identity/v3/projects/510ac9fb0af94a86945ce568629ed77c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:33.239806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:33.242300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:33.335574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226bed3-8b9c-4015-8d62-4a9ad7d62c61 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:33.349603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:33.350505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:33.350790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:33.351169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] PATH_INFO: `/v3/users/03dbaa3a55dd42b68098e06139b6bcd9` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:33.355753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03dbaa3a55dd42b68098e06139b6bcd9)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:33.357848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:33.427019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03dbaa3a55dd42b68098e06139b6bcd9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.459553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03dbaa3a55dd42b68098e06139b6bcd9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.460948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03dbaa3a55dd42b68098e06139b6bcd9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.478712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03dbaa3a55dd42b68098e06139b6bcd9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.480740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03dbaa3a55dd42b68098e06139b6bcd9'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.514070 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1010/2031] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:33 2021] DELETE /identity/v3/users/03dbaa3a55dd42b68098e06139b6bcd9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:33.598553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:33.600029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:33.682844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5cb7-afc2-4969-92b1-9bb16e1dc2c2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:33.741977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:33.742840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:33.743118 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:33.743388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] PATH_INFO: `/v3/projects/825538c619054605bfc8fdeb75d1c959` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:33.745932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=825538c619054605bfc8fdeb75d1c959)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:33.747877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:33.797683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825538c619054605bfc8fdeb75d1c959', 'request_id': 'req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.804400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825538c619054605bfc8fdeb75d1c959', 'request_id': 'req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.814027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825538c619054605bfc8fdeb75d1c959', 'request_id': 'req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.836609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] The token cache is being invalidate because project 825538c619054605bfc8fdeb75d1c959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:33.837200 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.838879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:33.843686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1022/2032] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:33 2021] DELETE /identity/v3/projects/825538c619054605bfc8fdeb75d1c959 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:33.847863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:33.849544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:33.871251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d32ee-5334-4c91-97b0-6ad8e6efe83f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:33.979838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:33.980818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:33.981186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:33.981536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] PATH_INFO: `/v3/users/0a8b83a56b104b76851af46d8cb81bdf` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:33.984065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8b83a56b104b76851af46d8cb81bdf)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:33.986440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:33.991289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:33.992844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:34.014773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0654-b870-4ed6-a0aa-5cdc69dc3e56 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:34.024702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:34.040928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.042364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.042847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] PATH_INFO: `/v3/projects/5867b593f6a04a0c939aab5f644f2861` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.044455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5867b593f6a04a0c939aab5f644f2861)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:34.048571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:34.081754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8b83a56b104b76851af46d8cb81bdf'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.096837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8b83a56b104b76851af46d8cb81bdf'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.097821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8b83a56b104b76851af46d8cb81bdf'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.109719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8b83a56b104b76851af46d8cb81bdf'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.110633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ebbd9566-e9f1-4e87-b998-0471d58f5f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8b83a56b104b76851af46d8cb81bdf'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.117184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5867b593f6a04a0c939aab5f644f2861', 'request_id': 'req-76c9ccad-226a-4c8e-861d-910b3c9a682c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.126307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5867b593f6a04a0c939aab5f644f2861', 'request_id': 'req-76c9ccad-226a-4c8e-861d-910b3c9a682c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.141576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5867b593f6a04a0c939aab5f644f2861', 'request_id': 'req-76c9ccad-226a-4c8e-861d-910b3c9a682c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.141826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1011/2033] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:33 2021] DELETE /identity/v3/users/0a8b83a56b104b76851af46d8cb81bdf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:34.190665 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] The token cache is being invalidate because project 5867b593f6a04a0c939aab5f644f2861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:34.191020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.196344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-76c9ccad-226a-4c8e-861d-910b3c9a682c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:34.199240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1023/2034] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:33 2021] DELETE /identity/v3/projects/5867b593f6a04a0c939aab5f644f2861 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:34.205016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b492-5a8b-4e58-b74b-812b75edee98 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.205310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b492-5a8b-4e58-b74b-812b75edee98 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.205588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b492-5a8b-4e58-b74b-812b75edee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.226473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8741b492-5a8b-4e58-b74b-812b75edee98 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:34.228005 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8741b492-5a8b-4e58-b74b-812b75edee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:34.321644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1012/2035] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:34.331311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b792f-b6ab-4370-976b-c11614a5e999 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.331660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b792f-b6ab-4370-976b-c11614a5e999 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.331975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b792f-b6ab-4370-976b-c11614a5e999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.357481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-602b792f-b6ab-4370-976b-c11614a5e999 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:34.358675 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-602b792f-b6ab-4370-976b-c11614a5e999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:34.366669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1024/2036] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:34.372484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b492-5a8b-4e58-b74b-812b75edee98 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:34.385025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b492-5a8b-4e58-b74b-812b75edee98 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:34.391295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:34.391754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.392116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.392773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.393516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:34.394510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:34.396360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:34.414509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1013/2037] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:38:34.419197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b792f-b6ab-4370-976b-c11614a5e999 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:34.433715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b792f-b6ab-4370-976b-c11614a5e999 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:34.441538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e240-f6f8-4746-8dab-ee40b0d36a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:34.442393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e240-f6f8-4746-8dab-ee40b0d36a13 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.442679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e240-f6f8-4746-8dab-ee40b0d36a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.442955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e240-f6f8-4746-8dab-ee40b0d36a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.443739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e240-f6f8-4746-8dab-ee40b0d36a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:34.447156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e240-f6f8-4746-8dab-ee40b0d36a13 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:34.485234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1025/2038] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:34 2021] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:34.487042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:34.500498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e34e8c-3f3b-402e-94e4-967005a9ffaf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:34.589346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7e7b-a18f-4403-b88f-dc0aa215a0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:34.590186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7e7b-a18f-4403-b88f-dc0aa215a0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.590476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7e7b-a18f-4403-b88f-dc0aa215a0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.590796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7e7b-a18f-4403-b88f-dc0aa215a0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.591891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7e7b-a18f-4403-b88f-dc0aa215a0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:34.593907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7e7b-a18f-4403-b88f-dc0aa215a0f5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:34.629641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1014/2039] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:34 2021] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:34.633589 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e240-f6f8-4746-8dab-ee40b0d36a13 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:34.646819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e240-f6f8-4746-8dab-ee40b0d36a13 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:34.655433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e6663-c628-475d-9591-943d4cb77d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:34.656677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6663-c628-475d-9591-943d4cb77d0f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.657646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6663-c628-475d-9591-943d4cb77d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.658219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6663-c628-475d-9591-943d4cb77d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.659334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e6663-c628-475d-9591-943d4cb77d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:34.662052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e6663-c628-475d-9591-943d4cb77d0f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:34.676422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1026/2040] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:34 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:34.680632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7e7b-a18f-4403-b88f-dc0aa215a0f5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:34.694305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7e7b-a18f-4403-b88f-dc0aa215a0f5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:34.701946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ff47-76da-4ee4-a18a-3c680caeced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:34.703619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ff47-76da-4ee4-a18a-3c680caeced6 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.704147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ff47-76da-4ee4-a18a-3c680caeced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.704700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ff47-76da-4ee4-a18a-3c680caeced6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.706747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ff47-76da-4ee4-a18a-3c680caeced6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:34.709494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ff47-76da-4ee4-a18a-3c680caeced6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:34.726539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1015/2041] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:34 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:34.731940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e6663-c628-475d-9591-943d4cb77d0f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:34.745499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e6663-c628-475d-9591-943d4cb77d0f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:34.750928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:34.751951 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.752311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.752643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] PATH_INFO: `/v3/projects/7f4d7e63dabb48f0a7d5af8964eab70d/users/18c51fe6aacd431da48c119e5457d80c/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.768142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4d7e63dabb48f0a7d5af8964eab70d, user_id=18c51fe6aacd431da48c119e5457d80c, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:34.770860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:34.787768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1027/2042] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:34 2021] PUT /identity/v3/projects/7f4d7e63dabb48f0a7d5af8964eab70d/users/18c51fe6aacd431da48c119e5457d80c/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:34.796418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60b05-74ee-4aa5-bb7f-82abf8899402 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.796758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60b05-74ee-4aa5-bb7f-82abf8899402 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.797042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60b05-74ee-4aa5-bb7f-82abf8899402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.830259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-2cc60b05-74ee-4aa5-bb7f-82abf8899402 None None] MFA Rules not processed for user `18c51fe6aacd431da48c119e5457d80c`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:34.831847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2cc60b05-74ee-4aa5-bb7f-82abf8899402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:34.839240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:34.841191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:34.937821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1016/2043] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:34 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:34.939392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a0242-1fd7-4330-a2a2-54be5bed5b85 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:34.944251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:34.945185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:34.945533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:34.945877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] PATH_INFO: `/v3/projects/788f3cd3087d4f73b7bbcdb3afad967f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:34.947158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=788f3cd3087d4f73b7bbcdb3afad967f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:34.948045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc60b05-74ee-4aa5-bb7f-82abf8899402 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:34.949244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:34.949872 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2cc60b05-74ee-4aa5-bb7f-82abf8899402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:34.997465 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788f3cd3087d4f73b7bbcdb3afad967f', 'request_id': 'req-a75b7ad3-c984-4543-a167-3ecd6355a84a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.004133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788f3cd3087d4f73b7bbcdb3afad967f', 'request_id': 'req-a75b7ad3-c984-4543-a167-3ecd6355a84a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.012254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788f3cd3087d4f73b7bbcdb3afad967f', 'request_id': 'req-a75b7ad3-c984-4543-a167-3ecd6355a84a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.017543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc60b05-74ee-4aa5-bb7f-82abf8899402 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.025781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] The token cache is being invalidate because project 788f3cd3087d4f73b7bbcdb3afad967f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:35.026223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.027074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a75b7ad3-c984-4543-a167-3ecd6355a84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.028674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1028/2044] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:34 2021] DELETE /identity/v3/projects/788f3cd3087d4f73b7bbcdb3afad967f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:35.037356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44caa-c0a5-41fb-9056-cf154a9910b4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.037356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44caa-c0a5-41fb-9056-cf154a9910b4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.037356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44caa-c0a5-41fb-9056-cf154a9910b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.064744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-def44caa-c0a5-41fb-9056-cf154a9910b4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:35.065943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-def44caa-c0a5-41fb-9056-cf154a9910b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.083212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4459d-81d9-48b5-836f-1a16f923f6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.084078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4459d-81d9-48b5-836f-1a16f923f6fb service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.084364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4459d-81d9-48b5-836f-1a16f923f6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.084644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4459d-81d9-48b5-836f-1a16f923f6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.086426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a0b4459d-81d9-48b5-836f-1a16f923f6fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.136408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1029/2045] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:35.137476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def44caa-c0a5-41fb-9056-cf154a9910b4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.138733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-def44caa-c0a5-41fb-9056-cf154a9910b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.149787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def44caa-c0a5-41fb-9056-cf154a9910b4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.149949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4459d-81d9-48b5-836f-1a16f923f6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.151323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4459d-81d9-48b5-836f-1a16f923f6fb service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:35.154827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.155537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.156231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.156231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] PATH_INFO: `/v3/users/0b6802f5fc884bb5ad0494ebc2a58f2a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.157646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6802f5fc884bb5ad0494ebc2a58f2a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.159907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:35.161863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1017/2046] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:34 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:38:35.167352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557def-6cca-444e-8ab2-a5644d05919a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.167352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557def-6cca-444e-8ab2-a5644d05919a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.167352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557def-6cca-444e-8ab2-a5644d05919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.184283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6f557def-6cca-444e-8ab2-a5644d05919a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:35.185731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6f557def-6cca-444e-8ab2-a5644d05919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.196038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1018/2047] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:35.200993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557def-6cca-444e-8ab2-a5644d05919a None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.221046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557def-6cca-444e-8ab2-a5644d05919a None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.227113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.228295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.228826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.229852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.230951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:35.231371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.233246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:35.247596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1019/2048] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:38:35.248793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.250445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.252744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6802f5fc884bb5ad0494ebc2a58f2a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.264474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63239003-fd32-4afd-9003-64720f5ae691 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.269355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.270233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.270520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.270795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] PATH_INFO: `/v3/users/18c51fe6aacd431da48c119e5457d80c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.271994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c51fe6aacd431da48c119e5457d80c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.273945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:35.274587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6802f5fc884bb5ad0494ebc2a58f2a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.285586 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6802f5fc884bb5ad0494ebc2a58f2a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.288028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6802f5fc884bb5ad0494ebc2a58f2a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.296346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6802f5fc884bb5ad0494ebc2a58f2a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.303364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1030/2049] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:35 2021] DELETE /identity/v3/users/0b6802f5fc884bb5ad0494ebc2a58f2a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:35.304244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.305758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.352230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c51fe6aacd431da48c119e5457d80c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.372049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c51fe6aacd431da48c119e5457d80c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.373208 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c51fe6aacd431da48c119e5457d80c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.388079 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c51fe6aacd431da48c119e5457d80c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.388755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-1faa25de-3885-40a0-8d96-a8dc1ef8b8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c51fe6aacd431da48c119e5457d80c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.397072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268b46c-3bd0-4b60-b148-4fca65b192f8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.402439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0bbd3-d109-4fec-841d-29abf8e0cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.403108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0bbd3-d109-4fec-841d-29abf8e0cb1a admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.403224 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1020/2050] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:35 2021] DELETE /identity/v3/users/18c51fe6aacd431da48c119e5457d80c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:35.403390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0bbd3-d109-4fec-841d-29abf8e0cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.403657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0bbd3-d109-4fec-841d-29abf8e0cb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.404446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0bbd3-d109-4fec-841d-29abf8e0cb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.404657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc69688-bf71-4377-8192-9d276c24c059 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.404931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc69688-bf71-4377-8192-9d276c24c059 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.405700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc69688-bf71-4377-8192-9d276c24c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.406530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0bbd3-d109-4fec-841d-29abf8e0cb1a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:35.429448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-dfc69688-bf71-4377-8192-9d276c24c059 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:35.430823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-dfc69688-bf71-4377-8192-9d276c24c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.446639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1031/2051] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:35 2021] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:35.452403 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530640-02f1-4e23-90c9-d1120aa01b1d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.452762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530640-02f1-4e23-90c9-d1120aa01b1d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.453114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530640-02f1-4e23-90c9-d1120aa01b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.483495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0b530640-02f1-4e23-90c9-d1120aa01b1d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:35.483495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0b530640-02f1-4e23-90c9-d1120aa01b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.519769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1021/2052] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:35.520726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc69688-bf71-4377-8192-9d276c24c059 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.522068 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-dfc69688-bf71-4377-8192-9d276c24c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.535063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc69688-bf71-4377-8192-9d276c24c059 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.553648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1032/2053] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:35.554396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530640-02f1-4e23-90c9-d1120aa01b1d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.555674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0b530640-02f1-4e23-90c9-d1120aa01b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.569113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530640-02f1-4e23-90c9-d1120aa01b1d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.577231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.578081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.578363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.579165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.580435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.582396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:35.616030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1033/2054] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:35 2021] POST /identity/v3/users => generated 305 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:35.617199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.617976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.618945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.619052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.619302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.620124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] PATH_INFO: `/v3/users/17af4a654a6843e5a04c396917f60365` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.621802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17af4a654a6843e5a04c396917f60365)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.624014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:35.631175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180985-8d42-48ff-84d5-37be3f347ca5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.636342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.637232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.637510 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.637779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] PATH_INFO: `/v3/users/ff38e25abdb7463ab57ee1d5c53f8273` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.638987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff38e25abdb7463ab57ee1d5c53f8273)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.641137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:35.683378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17af4a654a6843e5a04c396917f60365'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.694566 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff38e25abdb7463ab57ee1d5c53f8273'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.696216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17af4a654a6843e5a04c396917f60365'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.696948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17af4a654a6843e5a04c396917f60365'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.706632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17af4a654a6843e5a04c396917f60365'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.708136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17af4a654a6843e5a04c396917f60365'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.709228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff38e25abdb7463ab57ee1d5c53f8273'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.717583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff38e25abdb7463ab57ee1d5c53f8273'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.718336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff38e25abdb7463ab57ee1d5c53f8273'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.723938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1022/2055] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:35 2021] DELETE /identity/v3/users/17af4a654a6843e5a04c396917f60365 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:35.727349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.727349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.733718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff38e25abdb7463ab57ee1d5c53f8273'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:35.743207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1034/2056] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:35 2021] DELETE /identity/v3/users/ff38e25abdb7463ab57ee1d5c53f8273 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:35.744276 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:35.746005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.796469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c4b74-f31c-452c-93e5-b40bb592fd1a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.835848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f9642-2120-448c-97ba-cffa4487d637 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:35.841729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.842390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.843056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.843056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.848597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.916584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957f970-1166-4341-ab48-4034b0544321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:35.917818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957f970-1166-4341-ab48-4034b0544321 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:35.918100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957f970-1166-4341-ab48-4034b0544321 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:35.918399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957f970-1166-4341-ab48-4034b0544321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:35.925359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e957f970-1166-4341-ab48-4034b0544321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:35.980434 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:35.983323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.003349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1035/2057] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:36.004274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.005752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.005882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957f970-1166-4341-ab48-4034b0544321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.007328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957f970-1166-4341-ab48-4034b0544321 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.017711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4259bc-12b9-4abd-a699-cbb05b404029 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.022411 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1023/2058] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:36.022527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.023082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.023370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.023654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.024081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3173e-fb53-4cab-9abc-6729851315be None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.024431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3173e-fb53-4cab-9abc-6729851315be None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.024541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.024813 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3173e-fb53-4cab-9abc-6729851315be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.026665 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.038219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1036/2059] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:36 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:36.039245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.042557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.047886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-bfb3173e-fb53-4cab-9abc-6729851315be None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:36.049053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bfb3173e-fb53-4cab-9abc-6729851315be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.055184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65aba-254b-44a2-ad1d-5cd6ef276544 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.058416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1024/2060] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:36.059239 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3173e-fb53-4cab-9abc-6729851315be None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.065341 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.066598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.066883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.067163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] PATH_INFO: `/v3/projects/0e3e648ccf87421d9660e75180c946bd` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.068469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3e648ccf87421d9660e75180c946bd)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.068933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3173e-fb53-4cab-9abc-6729851315be None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.070410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.074989 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.075796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.076148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.076492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.077492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.079465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.091177 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1025/2061] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:36.092271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.094131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.108888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db6e7-1efa-4585-a025-3a60a803aabf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.112789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e6f4-0387-4c2c-955a-a217d538e9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.113429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e6f4-0387-4c2c-955a-a217d538e9ea service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.113720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e6f4-0387-4c2c-955a-a217d538e9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.113978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e6f4-0387-4c2c-955a-a217d538e9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.124118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48e6f4-0387-4c2c-955a-a217d538e9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.125484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48e6f4-0387-4c2c-955a-a217d538e9ea service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.129282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3e648ccf87421d9660e75180c946bd', 'request_id': 'req-d8fc8980-637a-4e07-8778-1ae5313e6c69'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.136366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3e648ccf87421d9660e75180c946bd', 'request_id': 'req-d8fc8980-637a-4e07-8778-1ae5313e6c69'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.145469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3e648ccf87421d9660e75180c946bd', 'request_id': 'req-d8fc8980-637a-4e07-8778-1ae5313e6c69'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.148172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1026/2062] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:36.150015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e6f4-0387-4c2c-955a-a217d538e9ea service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.160526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] The token cache is being invalidate because project 0e3e648ccf87421d9660e75180c946bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:36.160736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.161685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d8fc8980-637a-4e07-8778-1ae5313e6c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.164093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1037/2063] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:36 2021] DELETE /identity/v3/projects/0e3e648ccf87421d9660e75180c946bd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:36.164933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e6f4-0387-4c2c-955a-a217d538e9ea service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.171854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1ed5-cf34-4e8b-b989-cd52072cad0c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.172478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1ed5-cf34-4e8b-b989-cd52072cad0c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.172940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1ed5-cf34-4e8b-b989-cd52072cad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.192634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-fa3c1ed5-cf34-4e8b-b989-cd52072cad0c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:36.194151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fa3c1ed5-cf34-4e8b-b989-cd52072cad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.239789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45981145-c79b-491d-9a66-61bffad1ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.240845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45981145-c79b-491d-9a66-61bffad1ec8e admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.241168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45981145-c79b-491d-9a66-61bffad1ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.241482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45981145-c79b-491d-9a66-61bffad1ec8e admin admin] PATH_INFO: `/v3/projects/4923f976543d4323a6cb0c2c235c0b8c/users/ae4020024a0043e9a7e7078550bf64a8/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.256499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45981145-c79b-491d-9a66-61bffad1ec8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4923f976543d4323a6cb0c2c235c0b8c, user_id=ae4020024a0043e9a7e7078550bf64a8, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.259138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45981145-c79b-491d-9a66-61bffad1ec8e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.261203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1038/2064] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:36.269258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54996bc7-3ca5-4d53-b1a9-56e0e214f08d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.269544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54996bc7-3ca5-4d53-b1a9-56e0e214f08d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.270303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54996bc7-3ca5-4d53-b1a9-56e0e214f08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.281958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1027/2065] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:36 2021] PUT /identity/v3/projects/4923f976543d4323a6cb0c2c235c0b8c/users/ae4020024a0043e9a7e7078550bf64a8/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:36.289319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-54996bc7-3ca5-4d53-b1a9-56e0e214f08d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:36.290759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-54996bc7-3ca5-4d53-b1a9-56e0e214f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.291368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc8ee3-0074-4a57-93e4-1b6894dce7d5 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.291673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc8ee3-0074-4a57-93e4-1b6894dce7d5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.292059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc8ee3-0074-4a57-93e4-1b6894dce7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.323655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f9dc8ee3-0074-4a57-93e4-1b6894dce7d5 None None] MFA Rules not processed for user `ae4020024a0043e9a7e7078550bf64a8`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:36.325006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f9dc8ee3-0074-4a57-93e4-1b6894dce7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.393289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1039/2066] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:36.397704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54996bc7-3ca5-4d53-b1a9-56e0e214f08d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.402656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1028/2067] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:36 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:36.407073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc8ee3-0074-4a57-93e4-1b6894dce7d5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.408919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f9dc8ee3-0074-4a57-93e4-1b6894dce7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.409837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54996bc7-3ca5-4d53-b1a9-56e0e214f08d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.422076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.422758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.423055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.423312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.424077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:36.424406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.426047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc8ee3-0074-4a57-93e4-1b6894dce7d5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.426178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.435431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec09cd2-bdab-4236-a2f9-c70d8745c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.436216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09cd2-bdab-4236-a2f9-c70d8745c284 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.436474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09cd2-bdab-4236-a2f9-c70d8745c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.436750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09cd2-bdab-4236-a2f9-c70d8745c284 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.437490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec09cd2-bdab-4236-a2f9-c70d8745c284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.440108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec09cd2-bdab-4236-a2f9-c70d8745c284 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.454284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1040/2068] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:38:36.455976 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.474067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1029/2069] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:36 2021] POST /identity/v3/projects => generated 409 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:36.476177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795456c6-5b93-40db-80f6-c3f9b41f3c96 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.478229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec09cd2-bdab-4236-a2f9-c70d8745c284 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.567102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec09cd2-bdab-4236-a2f9-c70d8745c284 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.573565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61d57b-1a28-47e9-964c-6b36e2673342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.574410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61d57b-1a28-47e9-964c-6b36e2673342 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.574697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61d57b-1a28-47e9-964c-6b36e2673342 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.575195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61d57b-1a28-47e9-964c-6b36e2673342 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.575927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61d57b-1a28-47e9-964c-6b36e2673342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.578049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61d57b-1a28-47e9-964c-6b36e2673342 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.586316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685183e-3171-4050-a454-c7bb102f7927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.587376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685183e-3171-4050-a454-c7bb102f7927 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.587376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685183e-3171-4050-a454-c7bb102f7927 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.587850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685183e-3171-4050-a454-c7bb102f7927 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.588979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685183e-3171-4050-a454-c7bb102f7927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.591170 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685183e-3171-4050-a454-c7bb102f7927 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.617256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1030/2070] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:36 2021] POST /identity/v3/users => generated 311 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:36.623807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61d57b-1a28-47e9-964c-6b36e2673342 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.629882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1041/2071] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:36 2021] POST /identity/v3/projects => generated 393 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:36.632573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685183e-3171-4050-a454-c7bb102f7927 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.636657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61d57b-1a28-47e9-964c-6b36e2673342 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.727073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.727901 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.728287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.729770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.730676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.732469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.736972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685183e-3171-4050-a454-c7bb102f7927 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.747873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2156-946b-458e-81ed-7fdc7b128478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.748944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2156-946b-458e-81ed-7fdc7b128478 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.748944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2156-946b-458e-81ed-7fdc7b128478 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.749173 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2156-946b-458e-81ed-7fdc7b128478 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.749896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b2156-946b-458e-81ed-7fdc7b128478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.754185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b2156-946b-458e-81ed-7fdc7b128478 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.759351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1031/2072] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:36 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:36.763678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.765887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.792512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1042/2073] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:36 2021] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:36.792512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2156-946b-458e-81ed-7fdc7b128478 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.793942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26570f69-6b88-4c86-8157-a5d676713308 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.799650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.800754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.801131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.801517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] PATH_INFO: `/v3/projects/7f4d7e63dabb48f0a7d5af8964eab70d` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.802920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4d7e63dabb48f0a7d5af8964eab70d)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.805268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.820462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2156-946b-458e-81ed-7fdc7b128478 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:36.827217 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1aebc-606d-4024-91a1-3952a31a7158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:36.828169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1aebc-606d-4024-91a1-3952a31a7158 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:36.828452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1aebc-606d-4024-91a1-3952a31a7158 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:36.828981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1aebc-606d-4024-91a1-3952a31a7158 admin admin] PATH_INFO: `/v3/projects/c4c03d23b0d74cbb835d299eba3f043c/users/49971f5f0c2645c7842529e1946d3e7f/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:36.856136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1aebc-606d-4024-91a1-3952a31a7158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c03d23b0d74cbb835d299eba3f043c, user_id=49971f5f0c2645c7842529e1946d3e7f, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:36.860784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1aebc-606d-4024-91a1-3952a31a7158 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:36.871102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4d7e63dabb48f0a7d5af8964eab70d', 'request_id': 'req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.879670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4d7e63dabb48f0a7d5af8964eab70d', 'request_id': 'req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.889226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1043/2074] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:36 2021] PUT /identity/v3/projects/c4c03d23b0d74cbb835d299eba3f043c/users/49971f5f0c2645c7842529e1946d3e7f/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:36.889695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4d7e63dabb48f0a7d5af8964eab70d', 'request_id': 'req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.890601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1aebc-606d-4024-91a1-3952a31a7158 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.908792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] The token cache is being invalidate because project 7f4d7e63dabb48f0a7d5af8964eab70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:36.909085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.909967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:36.923743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1032/2075] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:36 2021] DELETE /identity/v3/projects/7f4d7e63dabb48f0a7d5af8964eab70d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:36.923743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:36.923743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:36.996847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1aebc-606d-4024-91a1-3952a31a7158 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.002530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.003225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.003504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.003871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.004666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.006293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.016345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c8176-0d88-4d91-a4b6-67a53d3e57a2 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.032193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.033742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1044/2076] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:36 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:37.036971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.037111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.037632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.037934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] PATH_INFO: `/v3/projects/271e9f884bfa42eaa5fea564d19e2f41` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.038877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.039288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] RBAC: Authorizing `identity:delete_project(project_id=271e9f884bfa42eaa5fea564d19e2f41)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.041333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.071282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3409-049c-4174-9923-7127479fe031 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.089495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.090535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.091171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.091736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.092703 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.095164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.115472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1045/2077] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:37 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:37.116880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.118992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.134573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271e9f884bfa42eaa5fea564d19e2f41', 'request_id': 'req-3454fde5-c637-4853-92e0-3f92e28681af'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.144060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132f7f5-6bad-492c-b83c-689425da3507 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.148679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271e9f884bfa42eaa5fea564d19e2f41', 'request_id': 'req-3454fde5-c637-4853-92e0-3f92e28681af'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.164205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271e9f884bfa42eaa5fea564d19e2f41', 'request_id': 'req-3454fde5-c637-4853-92e0-3f92e28681af'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.187729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] The token cache is being invalidate because project 271e9f884bfa42eaa5fea564d19e2f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:37.188155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.189145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.191090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1033/2078] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:36 2021] DELETE /identity/v3/projects/271e9f884bfa42eaa5fea564d19e2f41 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:37.191570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.192920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.216768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.217655 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.218061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.218337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] PATH_INFO: `/v3/projects/33683b89aaef454ab4713330fa6a4e61` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.219886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33683b89aaef454ab4713330fa6a4e61)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.221815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.271415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454fde5-c637-4853-92e0-3f92e28681af admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.277388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33683b89aaef454ab4713330fa6a4e61', 'request_id': 'req-386d04ad-af5b-4ec4-b86b-6334e86dbef2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.283610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33683b89aaef454ab4713330fa6a4e61', 'request_id': 'req-386d04ad-af5b-4ec4-b86b-6334e86dbef2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.292828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33683b89aaef454ab4713330fa6a4e61', 'request_id': 'req-386d04ad-af5b-4ec4-b86b-6334e86dbef2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.304930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] The token cache is being invalidate because project 33683b89aaef454ab4713330fa6a4e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:37.305221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.305893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:37.308359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1046/2079] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:37 2021] DELETE /identity/v3/projects/33683b89aaef454ab4713330fa6a4e61 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:37.308841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.310313 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.337864 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88f8e8-7186-422a-9699-a7ec7491501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.338700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f8e8-7186-422a-9699-a7ec7491501e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.338979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f8e8-7186-422a-9699-a7ec7491501e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.339253 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f8e8-7186-422a-9699-a7ec7491501e admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.340027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88f8e8-7186-422a-9699-a7ec7491501e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.341610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88f8e8-7186-422a-9699-a7ec7491501e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.352472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1034/2080] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:37 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:37.353759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8674c-36bb-4d07-ae9a-2afaecb8249c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.354598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8674c-36bb-4d07-ae9a-2afaecb8249c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.355096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8674c-36bb-4d07-ae9a-2afaecb8249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.375097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-54e8674c-36bb-4d07-ae9a-2afaecb8249c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:37.376695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-54e8674c-36bb-4d07-ae9a-2afaecb8249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.384049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d04ad-af5b-4ec4-b86b-6334e86dbef2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.384922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1035/2081] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:37.386361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785887-e3c5-46cb-b1f2-82590b99dd38 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.386652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785887-e3c5-46cb-b1f2-82590b99dd38 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.386928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785887-e3c5-46cb-b1f2-82590b99dd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.391986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.394352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.394635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.394910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] PATH_INFO: `/v3/projects/c4c03d23b0d74cbb835d299eba3f043c/users/49971f5f0c2645c7842529e1946d3e7f/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.396818 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c03d23b0d74cbb835d299eba3f043c, user_id=49971f5f0c2645c7842529e1946d3e7f, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.399597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.405614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-81785887-e3c5-46cb-b1f2-82590b99dd38 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:37.406887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-81785887-e3c5-46cb-b1f2-82590b99dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.410811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1047/2082] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:37 2021] PUT /identity/v3/projects/c4c03d23b0d74cbb835d299eba3f043c/users/49971f5f0c2645c7842529e1946d3e7f/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:37.411848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.413550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.475391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1036/2083] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:37.476646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7fe69-e056-4633-b2f0-88db635d94cb None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.476938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7fe69-e056-4633-b2f0-88db635d94cb None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.477216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7fe69-e056-4633-b2f0-88db635d94cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.484797 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a178-b96a-4f7c-9edd-8d1a5608137b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.489355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4df19-78da-4ea9-b01b-33ac8410be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.490239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4df19-78da-4ea9-b01b-33ac8410be15 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.490518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4df19-78da-4ea9-b01b-33ac8410be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.490794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4df19-78da-4ea9-b01b-33ac8410be15 admin admin] PATH_INFO: `/v3/projects/89e53e09771a4a478b48fa6e6f571d81/users/90c3a2e7255c4a909fc7e09730344930/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.495349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c6c7fe69-e056-4633-b2f0-88db635d94cb None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:37.497095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c6c7fe69-e056-4633-b2f0-88db635d94cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.504887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1037/2084] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:37.505950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4df19-78da-4ea9-b01b-33ac8410be15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e53e09771a4a478b48fa6e6f571d81, user_id=90c3a2e7255c4a909fc7e09730344930, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.506114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16c7d-2dcc-45b7-bb9e-e1234931b9bd None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.506393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16c7d-2dcc-45b7-bb9e-e1234931b9bd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.506664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16c7d-2dcc-45b7-bb9e-e1234931b9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.508746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4df19-78da-4ea9-b01b-33ac8410be15 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.521730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1048/2085] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:37 2021] PUT /identity/v3/projects/89e53e09771a4a478b48fa6e6f571d81/users/90c3a2e7255c4a909fc7e09730344930/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:37.523299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1006-c45a-48cd-9caa-70dce637c18e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.523641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1006-c45a-48cd-9caa-70dce637c18e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.523950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1006-c45a-48cd-9caa-70dce637c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.535168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3bc16c7d-2dcc-45b7-bb9e-e1234931b9bd None None] MFA Rules not processed for user `49971f5f0c2645c7842529e1946d3e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:37.536346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3bc16c7d-2dcc-45b7-bb9e-e1234931b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.540580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-96aa1006-c45a-48cd-9caa-70dce637c18e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:37.542341 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-96aa1006-c45a-48cd-9caa-70dce637c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.609235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1049/2086] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:37.609452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1006-c45a-48cd-9caa-70dce637c18e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.622035 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1006-c45a-48cd-9caa-70dce637c18e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.626580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.627222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.627378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1038/2087] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:37.627515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.627894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.628534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:37.628813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.629361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f994f-7b1e-424b-997d-3a230dbe85b7 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.629862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f994f-7b1e-424b-997d-3a230dbe85b7 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.630357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f994f-7b1e-424b-997d-3a230dbe85b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.630606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.643701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1050/2088] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:38:37.644417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.650484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3d0f994f-7b1e-424b-997d-3a230dbe85b7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:37.652247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3d0f994f-7b1e-424b-997d-3a230dbe85b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.653688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745fdc5-6c83-44d6-b15f-dfb032515198 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.658062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.658704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.658987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.659268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.659528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1039/2089] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:37.660043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:37.660351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.660442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f994f-7b1e-424b-997d-3a230dbe85b7 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.661554 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3d0f994f-7b1e-424b-997d-3a230dbe85b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.661928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.676654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1051/2090] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:38:37.676654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.685954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c407b-3c5d-4163-9c4a-14f79e0d86b8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.690389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.691036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.691317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.691588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.692314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.694224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.720586 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1052/2091] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:37.721412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.723030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:37.724868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f994f-7b1e-424b-997d-3a230dbe85b7 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.773819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b70e-996d-4cc5-aeab-c0aff02a0d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.774470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b70e-996d-4cc5-aeab-c0aff02a0d82 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.774820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b70e-996d-4cc5-aeab-c0aff02a0d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.775122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b70e-996d-4cc5-aeab-c0aff02a0d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.779319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24badb-f86f-4f07-a005-fda58f8da343 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.782933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19672c-19c7-4625-bbd2-2a24252e1626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.783590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19672c-19c7-4625-bbd2-2a24252e1626 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.783902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19672c-19c7-4625-bbd2-2a24252e1626 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.784176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19672c-19c7-4625-bbd2-2a24252e1626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.833264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9b70e-996d-4cc5-aeab-c0aff02a0d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.834700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9b70e-996d-4cc5-aeab-c0aff02a0d82 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.843626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19672c-19c7-4625-bbd2-2a24252e1626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.845410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19672c-19c7-4625-bbd2-2a24252e1626 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.848289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1040/2092] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:37 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:37.849027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b70e-996d-4cc5-aeab-c0aff02a0d82 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.854938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1053/2093] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:37.855674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19672c-19c7-4625-bbd2-2a24252e1626 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.858733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b70e-996d-4cc5-aeab-c0aff02a0d82 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.864356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a4957-ec84-49aa-995b-16726777af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.864697 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19672c-19c7-4625-bbd2-2a24252e1626 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:37.865311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4957-ec84-49aa-995b-16726777af0a admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.865739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4957-ec84-49aa-995b-16726777af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.866008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4957-ec84-49aa-995b-16726777af0a admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.866693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a4957-ec84-49aa-995b-16726777af0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.869158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a4957-ec84-49aa-995b-16726777af0a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.870571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17120b-a3e6-46b9-b4ba-bdb3f5bc2024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:37.871623 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17120b-a3e6-46b9-b4ba-bdb3f5bc2024 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:37.872085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17120b-a3e6-46b9-b4ba-bdb3f5bc2024 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:37.872367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17120b-a3e6-46b9-b4ba-bdb3f5bc2024 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:37.873061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17120b-a3e6-46b9-b4ba-bdb3f5bc2024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:37.874973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17120b-a3e6-46b9-b4ba-bdb3f5bc2024 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:37.903461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1054/2094] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:37.907743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1041/2095] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:37.908750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17120b-a3e6-46b9-b4ba-bdb3f5bc2024 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.909772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a4957-ec84-49aa-995b-16726777af0a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:37.924165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17120b-a3e6-46b9-b4ba-bdb3f5bc2024 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.002462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65429775-e35c-48e6-a73d-00f3f157bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.004114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429775-e35c-48e6-a73d-00f3f157bd71 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.004901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429775-e35c-48e6-a73d-00f3f157bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.005406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429775-e35c-48e6-a73d-00f3f157bd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.006345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65429775-e35c-48e6-a73d-00f3f157bd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.007467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a4957-ec84-49aa-995b-16726777af0a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.008633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65429775-e35c-48e6-a73d-00f3f157bd71 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.013917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5fd5a-864a-4e01-94b0-e2345644d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.014439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fd5a-864a-4e01-94b0-e2345644d2fd admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.014727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fd5a-864a-4e01-94b0-e2345644d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.015007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fd5a-864a-4e01-94b0-e2345644d2fd admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.015806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5fd5a-864a-4e01-94b0-e2345644d2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.018166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5fd5a-864a-4e01-94b0-e2345644d2fd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.027753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1055/2096] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:37 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:38.028504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65429775-e35c-48e6-a73d-00f3f157bd71 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.044085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1042/2097] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:37 2021] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:38.044913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5fd5a-864a-4e01-94b0-e2345644d2fd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.059030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5fd5a-864a-4e01-94b0-e2345644d2fd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.064042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49855e-02d6-4049-a78f-fb8f678dbe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.064713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49855e-02d6-4049-a78f-fb8f678dbe1c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.065058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49855e-02d6-4049-a78f-fb8f678dbe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.065428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49855e-02d6-4049-a78f-fb8f678dbe1c admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.066035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49855e-02d6-4049-a78f-fb8f678dbe1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.068078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49855e-02d6-4049-a78f-fb8f678dbe1c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.078907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1043/2098] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:38.082600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49855e-02d6-4049-a78f-fb8f678dbe1c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.094245 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49855e-02d6-4049-a78f-fb8f678dbe1c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.099661 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc48403-27d3-4f4b-8577-095e0972ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.100367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc48403-27d3-4f4b-8577-095e0972ead8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.100649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc48403-27d3-4f4b-8577-095e0972ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.100923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc48403-27d3-4f4b-8577-095e0972ead8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.101740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc48403-27d3-4f4b-8577-095e0972ead8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.103615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65429775-e35c-48e6-a73d-00f3f157bd71 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.104572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc48403-27d3-4f4b-8577-095e0972ead8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.108332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262620f1-ea44-43b7-8570-317d16a8662e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.108986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262620f1-ea44-43b7-8570-317d16a8662e service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.109270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262620f1-ea44-43b7-8570-317d16a8662e service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.109550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262620f1-ea44-43b7-8570-317d16a8662e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.111362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-262620f1-ea44-43b7-8570-317d16a8662e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:38.117373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1044/2099] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:38 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:38.118124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc48403-27d3-4f4b-8577-095e0972ead8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.128180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc48403-27d3-4f4b-8577-095e0972ead8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.136800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81561e95-1eff-41be-b471-34106edcf2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.137709 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81561e95-1eff-41be-b471-34106edcf2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.137988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81561e95-1eff-41be-b471-34106edcf2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.138254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81561e95-1eff-41be-b471-34106edcf2e6 admin admin] PATH_INFO: `/v3/projects/5382f89f5a5b4a04a670310de8ade3a3/users/18c8b8ccca6c46afbf77c48be278e23a/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.154034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81561e95-1eff-41be-b471-34106edcf2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5382f89f5a5b4a04a670310de8ade3a3, user_id=18c8b8ccca6c46afbf77c48be278e23a, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.156814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81561e95-1eff-41be-b471-34106edcf2e6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.187017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1045/2100] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:38 2021] PUT /identity/v3/projects/5382f89f5a5b4a04a670310de8ade3a3/users/18c8b8ccca6c46afbf77c48be278e23a/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:38.187017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81561e95-1eff-41be-b471-34106edcf2e6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.187289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262620f1-ea44-43b7-8570-317d16a8662e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.187289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262620f1-ea44-43b7-8570-317d16a8662e service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.194880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1056/2101] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:38 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:38.196333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d54cf-1be3-45cd-adad-af975943a40e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.196685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d54cf-1be3-45cd-adad-af975943a40e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.196898 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d54cf-1be3-45cd-adad-af975943a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.234975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2b8d54cf-1be3-45cd-adad-af975943a40e None None] MFA Rules not processed for user `18c8b8ccca6c46afbf77c48be278e23a`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:38.236722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2b8d54cf-1be3-45cd-adad-af975943a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:38.270972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81561e95-1eff-41be-b471-34106edcf2e6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.280676 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d713-010c-47a7-a8ba-36a1f1954e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.281415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d713-010c-47a7-a8ba-36a1f1954e54 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.281729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d713-010c-47a7-a8ba-36a1f1954e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.282116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d713-010c-47a7-a8ba-36a1f1954e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.283581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76d713-010c-47a7-a8ba-36a1f1954e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.288306 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76d713-010c-47a7-a8ba-36a1f1954e54 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.316828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1046/2102] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:38 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:38.320086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d713-010c-47a7-a8ba-36a1f1954e54 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.335596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1057/2103] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:38 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:38.339355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d713-010c-47a7-a8ba-36a1f1954e54 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.341270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d54cf-1be3-45cd-adad-af975943a40e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.345044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed957b6-da17-4f9b-b398-e5e10098aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.346054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed957b6-da17-4f9b-b398-e5e10098aa61 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.346435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed957b6-da17-4f9b-b398-e5e10098aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.346811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed957b6-da17-4f9b-b398-e5e10098aa61 admin admin] PATH_INFO: `/v3/projects/d39650a77ceb49bc9639eb1d4f578f05/users/dcc8a44d19a949d2a865ecd257316de7/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.354012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d54cf-1be3-45cd-adad-af975943a40e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.359972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ba21b-ec41-4768-b9f3-df8c3dbde619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.360975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba21b-ec41-4768-b9f3-df8c3dbde619 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.362053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba21b-ec41-4768-b9f3-df8c3dbde619 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.362555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba21b-ec41-4768-b9f3-df8c3dbde619 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.363438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ba21b-ec41-4768-b9f3-df8c3dbde619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.365467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed957b6-da17-4f9b-b398-e5e10098aa61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39650a77ceb49bc9639eb1d4f578f05, user_id=dcc8a44d19a949d2a865ecd257316de7, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.366354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ba21b-ec41-4768-b9f3-df8c3dbde619 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.368429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed957b6-da17-4f9b-b398-e5e10098aa61 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.395781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1047/2104] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:38 2021] PUT /identity/v3/projects/d39650a77ceb49bc9639eb1d4f578f05/users/dcc8a44d19a949d2a865ecd257316de7/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:38.407021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef04edf-dd76-464e-972e-016f4e43feb2 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.407815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef04edf-dd76-464e-972e-016f4e43feb2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.407936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef04edf-dd76-464e-972e-016f4e43feb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.409432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1058/2105] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:38 2021] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:38.413434 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ba21b-ec41-4768-b9f3-df8c3dbde619 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.445317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3ef04edf-dd76-464e-972e-016f4e43feb2 None None] MFA Rules not processed for user `dcc8a44d19a949d2a865ecd257316de7`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:38.446816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3ef04edf-dd76-464e-972e-016f4e43feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:38.509657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ba21b-ec41-4768-b9f3-df8c3dbde619 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.515756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdfa6-53ac-4777-ba95-45bd604274d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.516519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdfa6-53ac-4777-ba95-45bd604274d8 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.517020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdfa6-53ac-4777-ba95-45bd604274d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.517360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdfa6-53ac-4777-ba95-45bd604274d8 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.518524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdfa6-53ac-4777-ba95-45bd604274d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.521388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdfa6-53ac-4777-ba95-45bd604274d8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.536156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1048/2106] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:38 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:38.549574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef04edf-dd76-464e-972e-016f4e43feb2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.551465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3ef04edf-dd76-464e-972e-016f4e43feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:38.583633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1059/2107] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:38 2021] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:38.585205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdfa6-53ac-4777-ba95-45bd604274d8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.599504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdfa6-53ac-4777-ba95-45bd604274d8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.606120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77738b-7985-4fc4-b295-ff69e2b31af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.607800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77738b-7985-4fc4-b295-ff69e2b31af1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.608122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77738b-7985-4fc4-b295-ff69e2b31af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.608356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77738b-7985-4fc4-b295-ff69e2b31af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.609253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77738b-7985-4fc4-b295-ff69e2b31af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.611516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77738b-7985-4fc4-b295-ff69e2b31af1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.624898 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1060/2108] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:38 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:38.630199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77738b-7985-4fc4-b295-ff69e2b31af1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.648005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77738b-7985-4fc4-b295-ff69e2b31af1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.648479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef04edf-dd76-464e-972e-016f4e43feb2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.654290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f18593-0fbb-40ce-94c0-6b4206945c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.657749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18593-0fbb-40ce-94c0-6b4206945c4f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.658249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18593-0fbb-40ce-94c0-6b4206945c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.658714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18593-0fbb-40ce-94c0-6b4206945c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.660431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f18593-0fbb-40ce-94c0-6b4206945c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.662711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f18593-0fbb-40ce-94c0-6b4206945c4f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.665477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1f042-262a-42b4-920e-7bdd6892ba50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.667139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f042-262a-42b4-920e-7bdd6892ba50 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.667695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f042-262a-42b4-920e-7bdd6892ba50 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.668091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f042-262a-42b4-920e-7bdd6892ba50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.679218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1f042-262a-42b4-920e-7bdd6892ba50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.680712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1f042-262a-42b4-920e-7bdd6892ba50 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.688737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1061/2109] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:38 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:38.691361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f18593-0fbb-40ce-94c0-6b4206945c4f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:38.694069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1049/2110] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:38 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:38.702481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f18593-0fbb-40ce-94c0-6b4206945c4f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:38.716538 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e3361-3114-4560-9f7e-9a8fd172a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:38.717520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e3361-3114-4560-9f7e-9a8fd172a46d admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.717876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e3361-3114-4560-9f7e-9a8fd172a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.718261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e3361-3114-4560-9f7e-9a8fd172a46d admin admin] PATH_INFO: `/v3/projects/7afb14ae2c804f488cf6e67b836fd42e/users/95ccab79a90842429a71bef1c3928a68/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.734695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e3361-3114-4560-9f7e-9a8fd172a46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afb14ae2c804f488cf6e67b836fd42e, user_id=95ccab79a90842429a71bef1c3928a68, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:38.737777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e3361-3114-4560-9f7e-9a8fd172a46d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:38.753804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1062/2111] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:38 2021] PUT /identity/v3/projects/7afb14ae2c804f488cf6e67b836fd42e/users/95ccab79a90842429a71bef1c3928a68/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:38.765168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632df8f5-1aa4-410a-8364-f000131ab269 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:38.765467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632df8f5-1aa4-410a-8364-f000131ab269 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:38.765748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632df8f5-1aa4-410a-8364-f000131ab269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:38.816482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-632df8f5-1aa4-410a-8364-f000131ab269 None None] MFA Rules not processed for user `95ccab79a90842429a71bef1c3928a68`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:38.819651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-632df8f5-1aa4-410a-8364-f000131ab269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:38.920255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1050/2112] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:38 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:38.925015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e3361-3114-4560-9f7e-9a8fd172a46d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:39.009715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e3361-3114-4560-9f7e-9a8fd172a46d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:39.015941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1f40c-8890-4770-98f3-dd2acf900d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:39.016906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1f40c-8890-4770-98f3-dd2acf900d00 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:39.017239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1f40c-8890-4770-98f3-dd2acf900d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:39.017601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1f40c-8890-4770-98f3-dd2acf900d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:39.018214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1f40c-8890-4770-98f3-dd2acf900d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:39.020225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1f40c-8890-4770-98f3-dd2acf900d00 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:39.070280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1063/2113] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:38 2021] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:39.085929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632df8f5-1aa4-410a-8364-f000131ab269 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:39.103480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632df8f5-1aa4-410a-8364-f000131ab269 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:39.173936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d15ec-76e1-461a-b6dd-43e091ecd638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:39.174615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d15ec-76e1-461a-b6dd-43e091ecd638 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:39.174923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d15ec-76e1-461a-b6dd-43e091ecd638 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:39.175250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d15ec-76e1-461a-b6dd-43e091ecd638 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:39.175905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d15ec-76e1-461a-b6dd-43e091ecd638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:39.177849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d15ec-76e1-461a-b6dd-43e091ecd638 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:39.198851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1051/2114] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:39 2021] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:39.202813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1f40c-8890-4770-98f3-dd2acf900d00 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:39.212523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1f40c-8890-4770-98f3-dd2acf900d00 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:39.217517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78f223-c113-4679-9548-ad01cf17d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:39.218286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78f223-c113-4679-9548-ad01cf17d415 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:39.218688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78f223-c113-4679-9548-ad01cf17d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:39.219063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78f223-c113-4679-9548-ad01cf17d415 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:39.220182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78f223-c113-4679-9548-ad01cf17d415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:39.221955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78f223-c113-4679-9548-ad01cf17d415 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:39.233139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1064/2115] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:39.237334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d15ec-76e1-461a-b6dd-43e091ecd638 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:39.247392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d15ec-76e1-461a-b6dd-43e091ecd638 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:39.251874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d788-8e34-4d05-9beb-9e3b5a07f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:39.252769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d788-8e34-4d05-9beb-9e3b5a07f8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:39.253053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d788-8e34-4d05-9beb-9e3b5a07f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:39.253328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d788-8e34-4d05-9beb-9e3b5a07f8dd admin admin] PATH_INFO: `/v3/projects/789249ef77d442cc92df81d10efb7667/users/1004964081934fc3bde7ad77b2e7a039/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:39.268979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3d788-8e34-4d05-9beb-9e3b5a07f8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=789249ef77d442cc92df81d10efb7667, user_id=1004964081934fc3bde7ad77b2e7a039, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:39.271664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3d788-8e34-4d05-9beb-9e3b5a07f8dd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:39.285551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1052/2116] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:39 2021] PUT /identity/v3/projects/789249ef77d442cc92df81d10efb7667/users/1004964081934fc3bde7ad77b2e7a039/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:39.289392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78f223-c113-4679-9548-ad01cf17d415 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:39.299424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78f223-c113-4679-9548-ad01cf17d415 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:39.355568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12b79-d0b1-4a1a-be06-0ba40df353fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:39.356270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12b79-d0b1-4a1a-be06-0ba40df353fe admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:39.356547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12b79-d0b1-4a1a-be06-0ba40df353fe admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:39.356817 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12b79-d0b1-4a1a-be06-0ba40df353fe admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:39.357534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f12b79-d0b1-4a1a-be06-0ba40df353fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:39.359120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f12b79-d0b1-4a1a-be06-0ba40df353fe admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:39.368607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1065/2117] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:39 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:39.374935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d788-8e34-4d05-9beb-9e3b5a07f8dd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:39.384721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d788-8e34-4d05-9beb-9e3b5a07f8dd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:39.389755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaa2ab-4280-4344-b32b-a31adae1f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:39.390634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa2ab-4280-4344-b32b-a31adae1f3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:39.390914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa2ab-4280-4344-b32b-a31adae1f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:39.391182 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa2ab-4280-4344-b32b-a31adae1f3bc admin admin] PATH_INFO: `/v3/projects/789249ef77d442cc92df81d10efb7667/users/1004964081934fc3bde7ad77b2e7a039/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:39.393046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaa2ab-4280-4344-b32b-a31adae1f3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=789249ef77d442cc92df81d10efb7667, user_id=1004964081934fc3bde7ad77b2e7a039, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:39.395684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaa2ab-4280-4344-b32b-a31adae1f3bc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:39.406755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1053/2118] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:39 2021] PUT /identity/v3/projects/789249ef77d442cc92df81d10efb7667/users/1004964081934fc3bde7ad77b2e7a039/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:38:39.417909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaa4e8-0e6c-4362-8bdf-7de83cb666ef None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:39.418270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaa4e8-0e6c-4362-8bdf-7de83cb666ef None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:39.418634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaa4e8-0e6c-4362-8bdf-7de83cb666ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:39.445596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5ceaa4e8-0e6c-4362-8bdf-7de83cb666ef None None] MFA Rules not processed for user `1004964081934fc3bde7ad77b2e7a039`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:39.446766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5ceaa4e8-0e6c-4362-8bdf-7de83cb666ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:39.533437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1066/2119] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:39 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:39.548146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaa2ab-4280-4344-b32b-a31adae1f3bc admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:39.619125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaa2ab-4280-4344-b32b-a31adae1f3bc admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:39.624054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c00f85-cbce-463d-ac73-11072352540f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:39.624869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00f85-cbce-463d-ac73-11072352540f service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:39.625255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00f85-cbce-463d-ac73-11072352540f service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:39.625584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00f85-cbce-463d-ac73-11072352540f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:39.716465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c00f85-cbce-463d-ac73-11072352540f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:39.717920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c00f85-cbce-463d-ac73-11072352540f service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:39.735789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1054/2120] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:39 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:42.176104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f12c-3525-4fb8-ac4e-cd55bd04e269 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:42.176556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f12c-3525-4fb8-ac4e-cd55bd04e269 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:42.176645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f12c-3525-4fb8-ac4e-cd55bd04e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:42.208533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ba99f12c-3525-4fb8-ac4e-cd55bd04e269 None None] MFA Rules not processed for user `90c3a2e7255c4a909fc7e09730344930`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:42.209704 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ba99f12c-3525-4fb8-ac4e-cd55bd04e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:42.287294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1067/2121] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:42.297081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2cfe4-8312-4993-acf8-fbfeab8d1433 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:42.297583 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2cfe4-8312-4993-acf8-fbfeab8d1433 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:42.297668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2cfe4-8312-4993-acf8-fbfeab8d1433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:42.315141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-0eb2cfe4-8312-4993-acf8-fbfeab8d1433 None None] MFA Rules not processed for user `90c3a2e7255c4a909fc7e09730344930`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:42.316373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0eb2cfe4-8312-4993-acf8-fbfeab8d1433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:42.323727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1055/2122] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:43.054329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99f12c-3525-4fb8-ac4e-cd55bd04e269 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:43.055922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ba99f12c-3525-4fb8-ac4e-cd55bd04e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:43.138452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99f12c-3525-4fb8-ac4e-cd55bd04e269 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:43.143740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe649-7103-4cb3-97cd-e30d61a095eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:43.144483 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe649-7103-4cb3-97cd-e30d61a095eb service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:43.144845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe649-7103-4cb3-97cd-e30d61a095eb service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:43.145256 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe649-7103-4cb3-97cd-e30d61a095eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:43.156600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe649-7103-4cb3-97cd-e30d61a095eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:43.158363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe649-7103-4cb3-97cd-e30d61a095eb service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:43.169504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1068/2123] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:43 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:43.824020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636aacb-fb8c-49db-8445-ce3116f7eadf None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:43.825146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636aacb-fb8c-49db-8445-ce3116f7eadf None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:43.825398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636aacb-fb8c-49db-8445-ce3116f7eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:43.855348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-5636aacb-fb8c-49db-8445-ce3116f7eadf None None] MFA Rules not processed for user `90c3a2e7255c4a909fc7e09730344930`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:43.856711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5636aacb-fb8c-49db-8445-ce3116f7eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:43.868139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1056/2124] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:44.599330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe649-7103-4cb3-97cd-e30d61a095eb service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:44.623518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe649-7103-4cb3-97cd-e30d61a095eb service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:44.631140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a1aef-d10e-4b5a-a780-573c938380cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:44.632149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a1aef-d10e-4b5a-a780-573c938380cc service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:44.632550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a1aef-d10e-4b5a-a780-573c938380cc service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:44.632897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a1aef-d10e-4b5a-a780-573c938380cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:44.717044 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a1aef-d10e-4b5a-a780-573c938380cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:44.718694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a1aef-d10e-4b5a-a780-573c938380cc service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:44.729305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1069/2125] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:44 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:45.525296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636aacb-fb8c-49db-8445-ce3116f7eadf None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:45.554130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636aacb-fb8c-49db-8445-ce3116f7eadf None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:45.565359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085215-aeee-4ba6-a4d4-46962e42f383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:45.566043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085215-aeee-4ba6-a4d4-46962e42f383 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:45.566398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085215-aeee-4ba6-a4d4-46962e42f383 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:45.566580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085215-aeee-4ba6-a4d4-46962e42f383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:45.593474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085215-aeee-4ba6-a4d4-46962e42f383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:45.595785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085215-aeee-4ba6-a4d4-46962e42f383 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:45.612737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1057/2126] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:45 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:47.226960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a1aef-d10e-4b5a-a780-573c938380cc service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:47.321902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a1aef-d10e-4b5a-a780-573c938380cc service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:47.329562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:47.330601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:47.331015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:47.331526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] PATH_INFO: `/v3/users/ae4020024a0043e9a7e7078550bf64a8` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:47.333329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4020024a0043e9a7e7078550bf64a8)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:47.338769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:47.421403 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4020024a0043e9a7e7078550bf64a8'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:47.434610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4020024a0043e9a7e7078550bf64a8'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:47.442546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4020024a0043e9a7e7078550bf64a8'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:47.443360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4020024a0043e9a7e7078550bf64a8'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:47.454847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4020024a0043e9a7e7078550bf64a8'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:47.462680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1070/2127] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:47 2021] DELETE /identity/v3/users/ae4020024a0043e9a7e7078550bf64a8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:47.467135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231069-2c2b-4de7-a1f6-fb65b19d1548 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:47.467670 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231069-2c2b-4de7-a1f6-fb65b19d1548 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:47.467857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231069-2c2b-4de7-a1f6-fb65b19d1548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:47.492433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-59231069-2c2b-4de7-a1f6-fb65b19d1548 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:47.493601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-59231069-2c2b-4de7-a1f6-fb65b19d1548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:47.569366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1058/2128] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:47.587156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:47.588716 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:47.657830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c088f6-4aaa-43cc-888d-7d1b62d861ff admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:47.661683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01637fb3-bd14-44f1-b5ed-f4830f020133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:47.662471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01637fb3-bd14-44f1-b5ed-f4830f020133 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:47.663202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01637fb3-bd14-44f1-b5ed-f4830f020133 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:47.663202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01637fb3-bd14-44f1-b5ed-f4830f020133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:47.680825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01637fb3-bd14-44f1-b5ed-f4830f020133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:47.683530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01637fb3-bd14-44f1-b5ed-f4830f020133 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:47.693820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1071/2129] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:48.614616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231069-2c2b-4de7-a1f6-fb65b19d1548 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:48.616108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-59231069-2c2b-4de7-a1f6-fb65b19d1548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:48.637415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231069-2c2b-4de7-a1f6-fb65b19d1548 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:48.643910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:48.645020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:48.645454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:48.645880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] PATH_INFO: `/v3/projects/4923f976543d4323a6cb0c2c235c0b8c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:48.647259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4923f976543d4323a6cb0c2c235c0b8c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:48.657779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:48.739062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4923f976543d4323a6cb0c2c235c0b8c', 'request_id': 'req-562b5f81-e604-42d1-88d8-a54dad33b15c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.746564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4923f976543d4323a6cb0c2c235c0b8c', 'request_id': 'req-562b5f81-e604-42d1-88d8-a54dad33b15c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.758367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4923f976543d4323a6cb0c2c235c0b8c', 'request_id': 'req-562b5f81-e604-42d1-88d8-a54dad33b15c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.771960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] The token cache is being invalidate because project 4923f976543d4323a6cb0c2c235c0b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:48.773604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.774596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.777343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1059/2130] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:48 2021] DELETE /identity/v3/projects/4923f976543d4323a6cb0c2c235c0b8c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:48.781149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01637fb3-bd14-44f1-b5ed-f4830f020133 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:48.795695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01637fb3-bd14-44f1-b5ed-f4830f020133 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:48.868764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:48.870160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:48.870437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:48.870889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] PATH_INFO: `/v3/users/49971f5f0c2645c7842529e1946d3e7f` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:48.872045 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=49971f5f0c2645c7842529e1946d3e7f)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:48.874281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:48.939905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49971f5f0c2645c7842529e1946d3e7f'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.952746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49971f5f0c2645c7842529e1946d3e7f'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.959638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49971f5f0c2645c7842529e1946d3e7f'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.960394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49971f5f0c2645c7842529e1946d3e7f'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.969171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-0f534500-14ed-44bf-bd72-230868c89dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49971f5f0c2645c7842529e1946d3e7f'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:48.977067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1072/2131] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:48 2021] DELETE /identity/v3/users/49971f5f0c2645c7842529e1946d3e7f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:49.316937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:49.318432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:49.337652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b5f81-e604-42d1-88d8-a54dad33b15c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:49.393245 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:49.394036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.394333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.394605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] PATH_INFO: `/v3/projects/c4c03d23b0d74cbb835d299eba3f043c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.395757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c03d23b0d74cbb835d299eba3f043c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:49.398009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:49.443902 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c03d23b0d74cbb835d299eba3f043c', 'request_id': 'req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:49.450508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c03d23b0d74cbb835d299eba3f043c', 'request_id': 'req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:49.457700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c03d23b0d74cbb835d299eba3f043c', 'request_id': 'req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:49.468123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] The token cache is being invalidate because project c4c03d23b0d74cbb835d299eba3f043c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:49.468406 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:49.469018 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-db5159ea-71c4-42c3-ba51-77a6bc8e4f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:49.470805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1060/2132] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:49 2021] DELETE /identity/v3/projects/c4c03d23b0d74cbb835d299eba3f043c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:49.476480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af652-01ae-47c4-82e5-1a334085ba23 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.476768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af652-01ae-47c4-82e5-1a334085ba23 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.477079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af652-01ae-47c4-82e5-1a334085ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.494664 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-7b6af652-01ae-47c4-82e5-1a334085ba23 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:49.495999 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7b6af652-01ae-47c4-82e5-1a334085ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:49.559041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1073/2133] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:49.567113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f6dd6-0f31-4ad0-94d4-94b677002cff None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.567400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f6dd6-0f31-4ad0-94d4-94b677002cff None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.567682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f6dd6-0f31-4ad0-94d4-94b677002cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.586025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-098f6dd6-0f31-4ad0-94d4-94b677002cff None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:49.587230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-098f6dd6-0f31-4ad0-94d4-94b677002cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:49.595754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1061/2134] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:49.599813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6af652-01ae-47c4-82e5-1a334085ba23 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:49.613466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6af652-01ae-47c4-82e5-1a334085ba23 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:49.617929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:49.618589 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.618929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.619253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.620139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:49.620448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:49.622057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:49.633375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1074/2135] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:38:49.637845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f6dd6-0f31-4ad0-94d4-94b677002cff None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:49.646691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f6dd6-0f31-4ad0-94d4-94b677002cff None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:49.651798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feedfd-13ca-4d4c-b101-df00d4e618f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:49.652485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feedfd-13ca-4d4c-b101-df00d4e618f9 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.652767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feedfd-13ca-4d4c-b101-df00d4e618f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.653045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feedfd-13ca-4d4c-b101-df00d4e618f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.653752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99feedfd-13ca-4d4c-b101-df00d4e618f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:49.655701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99feedfd-13ca-4d4c-b101-df00d4e618f9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:49.682223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1062/2136] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:49 2021] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:38:49.686869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:49.696519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a28d-f7b7-4cc9-9b9c-e3e0455c03cd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:49.757371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296ea75-c369-46b7-8891-5ff7de7dcb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:49.758040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296ea75-c369-46b7-8891-5ff7de7dcb0b admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.758320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296ea75-c369-46b7-8891-5ff7de7dcb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.758593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296ea75-c369-46b7-8891-5ff7de7dcb0b admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.759263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296ea75-c369-46b7-8891-5ff7de7dcb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:49.761562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296ea75-c369-46b7-8891-5ff7de7dcb0b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:49.781361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1075/2137] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:49 2021] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:49.785449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feedfd-13ca-4d4c-b101-df00d4e618f9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:49.795514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feedfd-13ca-4d4c-b101-df00d4e618f9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:49.799848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f30c-0ef5-46a2-aa3c-0132e8757fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:49.800533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f30c-0ef5-46a2-aa3c-0132e8757fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.800816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f30c-0ef5-46a2-aa3c-0132e8757fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.801087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f30c-0ef5-46a2-aa3c-0132e8757fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.801799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55f30c-0ef5-46a2-aa3c-0132e8757fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:49.803387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55f30c-0ef5-46a2-aa3c-0132e8757fd0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:49.813447 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1063/2138] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:49.817303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296ea75-c369-46b7-8891-5ff7de7dcb0b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:49.826967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296ea75-c369-46b7-8891-5ff7de7dcb0b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:49.831308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf604e-730e-4662-8f38-ee94058014af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:49.831992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf604e-730e-4662-8f38-ee94058014af admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.832276 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf604e-730e-4662-8f38-ee94058014af admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.832551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf604e-730e-4662-8f38-ee94058014af admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.833265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf604e-730e-4662-8f38-ee94058014af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:49.834871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf604e-730e-4662-8f38-ee94058014af admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:49.845132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1076/2139] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:49.848966 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f30c-0ef5-46a2-aa3c-0132e8757fd0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:49.858307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f30c-0ef5-46a2-aa3c-0132e8757fd0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:49.862711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:49.863580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.863901 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.864183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] PATH_INFO: `/v3/projects/278c13336de14a378d7ce3d771396645/users/398517fd6a1248d4b868716965811739/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.878721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=278c13336de14a378d7ce3d771396645, user_id=398517fd6a1248d4b868716965811739, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:49.881434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:49.895770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1064/2140] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:49 2021] PUT /identity/v3/projects/278c13336de14a378d7ce3d771396645/users/398517fd6a1248d4b868716965811739/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:49.908230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e5d4-1700-47d3-ace4-feb235fc92cc None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:49.908451 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e5d4-1700-47d3-ace4-feb235fc92cc None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:49.908753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e5d4-1700-47d3-ace4-feb235fc92cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:49.933439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f343e5d4-1700-47d3-ace4-feb235fc92cc None None] MFA Rules not processed for user `398517fd6a1248d4b868716965811739`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:49.934587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f343e5d4-1700-47d3-ace4-feb235fc92cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:49.994151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1077/2141] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:49 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:50.004511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:50.006153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:50.061740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dc1e7-9537-4e9c-b32a-f628e9162b1a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:50.065371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a1500-9cab-4274-aa43-a74a428c6e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:50.066015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a1500-9cab-4274-aa43-a74a428c6e16 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:50.066295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a1500-9cab-4274-aa43-a74a428c6e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:50.066571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a1500-9cab-4274-aa43-a74a428c6e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:50.074874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a1500-9cab-4274-aa43-a74a428c6e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:50.076350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a1500-9cab-4274-aa43-a74a428c6e16 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:50.084465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1065/2142] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:50 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:53.090843 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343e5d4-1700-47d3-ace4-feb235fc92cc None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:53.092220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f343e5d4-1700-47d3-ace4-feb235fc92cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:53.153915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343e5d4-1700-47d3-ace4-feb235fc92cc None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:53.158134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:53.158992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:53.159275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:53.159555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] PATH_INFO: `/v3/users/18c8b8ccca6c46afbf77c48be278e23a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:53.160728 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c8b8ccca6c46afbf77c48be278e23a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:53.162679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:53.206396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c8b8ccca6c46afbf77c48be278e23a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.218544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c8b8ccca6c46afbf77c48be278e23a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.226528 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c8b8ccca6c46afbf77c48be278e23a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.227527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c8b8ccca6c46afbf77c48be278e23a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.235598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c8b8ccca6c46afbf77c48be278e23a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.241394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1078/2143] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:53 2021] DELETE /identity/v3/users/18c8b8ccca6c46afbf77c48be278e23a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:53.246439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e498ce6-4038-4ba0-9f0b-f28cfc700db9 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:53.246895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e498ce6-4038-4ba0-9f0b-f28cfc700db9 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:53.246984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e498ce6-4038-4ba0-9f0b-f28cfc700db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:53.263740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1e498ce6-4038-4ba0-9f0b-f28cfc700db9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:53.264885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1e498ce6-4038-4ba0-9f0b-f28cfc700db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:53.322345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1066/2144] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:53.332576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:53.333936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:53.393881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815883f-3b8c-4ab8-9e3c-62ace8154dcd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:53.397390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a74f8-4351-4b15-98ad-3aeae3d7a914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:53.398031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a74f8-4351-4b15-98ad-3aeae3d7a914 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:53.398308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a74f8-4351-4b15-98ad-3aeae3d7a914 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:53.398579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a74f8-4351-4b15-98ad-3aeae3d7a914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:53.406908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a74f8-4351-4b15-98ad-3aeae3d7a914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:53.408361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a74f8-4351-4b15-98ad-3aeae3d7a914 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:53.417378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1079/2145] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:38:53.735994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e498ce6-4038-4ba0-9f0b-f28cfc700db9 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:53.737366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1e498ce6-4038-4ba0-9f0b-f28cfc700db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:53.756096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e498ce6-4038-4ba0-9f0b-f28cfc700db9 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:53.772563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:53.773663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:53.774000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:53.774303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] PATH_INFO: `/v3/projects/5382f89f5a5b4a04a670310de8ade3a3` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:53.775509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5382f89f5a5b4a04a670310de8ade3a3)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:53.777563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:53.848155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5382f89f5a5b4a04a670310de8ade3a3', 'request_id': 'req-d6d2bfca-c131-414a-b131-66bc827cb42a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.859607 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5382f89f5a5b4a04a670310de8ade3a3', 'request_id': 'req-d6d2bfca-c131-414a-b131-66bc827cb42a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.866385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5382f89f5a5b4a04a670310de8ade3a3', 'request_id': 'req-d6d2bfca-c131-414a-b131-66bc827cb42a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.879053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] The token cache is being invalidate because project 5382f89f5a5b4a04a670310de8ade3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:53.879423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.880165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:53.881792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1067/2146] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:53 2021] DELETE /identity/v3/projects/5382f89f5a5b4a04a670310de8ade3a3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:53.885713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a74f8-4351-4b15-98ad-3aeae3d7a914 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:53.895540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a74f8-4351-4b15-98ad-3aeae3d7a914 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:53.958889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:53.960005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:53.960491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:53.960750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] PATH_INFO: `/v3/users/95ccab79a90842429a71bef1c3928a68` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:53.962393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ccab79a90842429a71bef1c3928a68)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:53.965585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:54.016467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ccab79a90842429a71bef1c3928a68'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.037390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ccab79a90842429a71bef1c3928a68'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.047695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ccab79a90842429a71bef1c3928a68'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.048593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ccab79a90842429a71bef1c3928a68'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.056572 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ccab79a90842429a71bef1c3928a68'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.067228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1080/2147] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:53 2021] DELETE /identity/v3/users/95ccab79a90842429a71bef1c3928a68 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:54.366909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:54.368374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:54.381877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2bfca-c131-414a-b131-66bc827cb42a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:54.438167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:54.438949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:54.439228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:54.439503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] PATH_INFO: `/v3/projects/7afb14ae2c804f488cf6e67b836fd42e` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:54.440678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7afb14ae2c804f488cf6e67b836fd42e)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:54.442604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:54.487205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7afb14ae2c804f488cf6e67b836fd42e', 'request_id': 'req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.493024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7afb14ae2c804f488cf6e67b836fd42e', 'request_id': 'req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.500590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7afb14ae2c804f488cf6e67b836fd42e', 'request_id': 'req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.510314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] The token cache is being invalidate because project 7afb14ae2c804f488cf6e67b836fd42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:54.510598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.511215 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.512951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1068/2148] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:54 2021] DELETE /identity/v3/projects/7afb14ae2c804f488cf6e67b836fd42e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:54.516997 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:54.518346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:54.530258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a42d0-52e3-4736-96c4-8a8baa7af58d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:54.583544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:54.584438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:54.584719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:54.584990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] PATH_INFO: `/v3/users/1004964081934fc3bde7ad77b2e7a039` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:54.586114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1004964081934fc3bde7ad77b2e7a039)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:54.588050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:54.633021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1004964081934fc3bde7ad77b2e7a039'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.644936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1004964081934fc3bde7ad77b2e7a039'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.651408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1004964081934fc3bde7ad77b2e7a039'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.652763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1004964081934fc3bde7ad77b2e7a039'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.659914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-9aedf44f-8658-429c-8165-d652de5510ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1004964081934fc3bde7ad77b2e7a039'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:54.665732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1081/2149] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:38:54 2021] DELETE /identity/v3/users/1004964081934fc3bde7ad77b2e7a039 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:54.937758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:54.939223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:54.952118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c38ed-9e4f-41b3-b5b3-0aa3e10cc053 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:55.006468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:55.007320 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.007603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.007911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] PATH_INFO: `/v3/projects/789249ef77d442cc92df81d10efb7667` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.009031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=789249ef77d442cc92df81d10efb7667)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:55.010938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:55.055943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789249ef77d442cc92df81d10efb7667', 'request_id': 'req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:55.062665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789249ef77d442cc92df81d10efb7667', 'request_id': 'req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:55.071530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789249ef77d442cc92df81d10efb7667', 'request_id': 'req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:55.082152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] The token cache is being invalidate because project 789249ef77d442cc92df81d10efb7667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:38:55.082445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:55.083075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-de23e182-4ea2-4ba5-a9a8-dc2d681769ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:38:55.084646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1069/2150] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:38:54 2021] DELETE /identity/v3/projects/789249ef77d442cc92df81d10efb7667 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:55.090452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a8a84-bc3b-40c9-b8f4-48abd9c8fff7 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.090785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a8a84-bc3b-40c9-b8f4-48abd9c8fff7 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.091008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a8a84-bc3b-40c9-b8f4-48abd9c8fff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.112070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-fc2a8a84-bc3b-40c9-b8f4-48abd9c8fff7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:55.113252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fc2a8a84-bc3b-40c9-b8f4-48abd9c8fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:55.176841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1082/2151] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:55.185399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98acfee-3148-4416-92ee-dfc19cdba94a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.185680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98acfee-3148-4416-92ee-dfc19cdba94a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.191905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98acfee-3148-4416-92ee-dfc19cdba94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.204039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a98acfee-3148-4416-92ee-dfc19cdba94a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:55.205214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a98acfee-3148-4416-92ee-dfc19cdba94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:55.212539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1070/2152] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:38:55.216672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a8a84-bc3b-40c9-b8f4-48abd9c8fff7 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:55.225693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a8a84-bc3b-40c9-b8f4-48abd9c8fff7 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:55.230487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:55.231132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.231408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.231673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.232422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:38:55.232723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:55.234297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:55.245413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1083/2153] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:38:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:38:55.249846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98acfee-3148-4416-92ee-dfc19cdba94a None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:55.258205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98acfee-3148-4416-92ee-dfc19cdba94a None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:55.263016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32475d6-dc81-4545-9ef0-637af3628052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:55.263673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32475d6-dc81-4545-9ef0-637af3628052 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.263980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32475d6-dc81-4545-9ef0-637af3628052 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.264252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32475d6-dc81-4545-9ef0-637af3628052 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.265135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32475d6-dc81-4545-9ef0-637af3628052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:55.267021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32475d6-dc81-4545-9ef0-637af3628052 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:55.294633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1071/2154] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:38:55 2021] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:55.295764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:55.304802 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866861-3cdf-450d-b9d1-00a4db671df0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:55.359533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac562d67-d447-45f0-b629-4d3f15b28aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:55.360212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac562d67-d447-45f0-b629-4d3f15b28aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.360490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac562d67-d447-45f0-b629-4d3f15b28aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.360758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac562d67-d447-45f0-b629-4d3f15b28aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.361437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac562d67-d447-45f0-b629-4d3f15b28aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:55.363324 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac562d67-d447-45f0-b629-4d3f15b28aa1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:55.381932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1084/2155] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:38:55 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:38:55.386089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32475d6-dc81-4545-9ef0-637af3628052 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:55.395958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32475d6-dc81-4545-9ef0-637af3628052 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:55.400333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9e57-65bc-4fcb-b3c8-46d842aa4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:55.400988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9e57-65bc-4fcb-b3c8-46d842aa4086 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.401271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9e57-65bc-4fcb-b3c8-46d842aa4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.401552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9e57-65bc-4fcb-b3c8-46d842aa4086 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.402318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f9e57-65bc-4fcb-b3c8-46d842aa4086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:55.403946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f9e57-65bc-4fcb-b3c8-46d842aa4086 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:55.414142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1072/2156] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:38:55.418599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac562d67-d447-45f0-b629-4d3f15b28aa1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:55.428025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac562d67-d447-45f0-b629-4d3f15b28aa1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:55.432436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a084c8-084f-4fc7-ae81-e77ad51afa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:55.433712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a084c8-084f-4fc7-ae81-e77ad51afa31 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.434070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a084c8-084f-4fc7-ae81-e77ad51afa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.434351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a084c8-084f-4fc7-ae81-e77ad51afa31 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.435084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a084c8-084f-4fc7-ae81-e77ad51afa31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:55.436693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a084c8-084f-4fc7-ae81-e77ad51afa31 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:55.446389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1085/2157] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:38:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:38:55.450794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9e57-65bc-4fcb-b3c8-46d842aa4086 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:55.460116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9e57-65bc-4fcb-b3c8-46d842aa4086 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:55.464907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:55.466007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.466282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.466553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] PATH_INFO: `/v3/projects/390a8b33f669478db43fb9ad4259eccb/users/0db58e38f88a4965a94d51882db44960/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.480615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390a8b33f669478db43fb9ad4259eccb, user_id=0db58e38f88a4965a94d51882db44960, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:55.483947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:55.496684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1073/2158] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:38:55 2021] PUT /identity/v3/projects/390a8b33f669478db43fb9ad4259eccb/users/0db58e38f88a4965a94d51882db44960/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:38:55.501794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2876d-f2a7-45ed-85d1-1bd76bd3a375 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.502087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2876d-f2a7-45ed-85d1-1bd76bd3a375 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.502401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2876d-f2a7-45ed-85d1-1bd76bd3a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.519476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-64a2876d-f2a7-45ed-85d1-1bd76bd3a375 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:55.520671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-64a2876d-f2a7-45ed-85d1-1bd76bd3a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:55.576901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1086/2159] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:55.586961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:55.588605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:55.642476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41513f30-60c1-4cee-a26a-a65f665ff0e9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:55.645863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:55.646491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:55.646770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:55.647043 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:55.656190 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:55.657605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:55.666176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1074/2160] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:38:56.511096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b41435-e560-428f-a07e-2635c29a12e0 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:56.512367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b41435-e560-428f-a07e-2635c29a12e0 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:56.512484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b41435-e560-428f-a07e-2635c29a12e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:56.537833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c1b41435-e560-428f-a07e-2635c29a12e0 None None] MFA Rules not processed for user `0db58e38f88a4965a94d51882db44960`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:56.539001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c1b41435-e560-428f-a07e-2635c29a12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:56.601413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1087/2161] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:56 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:38:56.612153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:38:56.613622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:56.668817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64df90-df36-4ae7-a90c-015ab2269f37 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:38:56.672299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:38:56.672949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:56.673227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:56.673498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:56.681546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:38:56.683019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:38:56.692002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1075/2162] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:38:56 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:38:58.027946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7a642-ceda-4144-9d2a-9a6b6416b908 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:38:58.028762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7a642-ceda-4144-9d2a-9a6b6416b908 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:38:58.029048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7a642-ceda-4144-9d2a-9a6b6416b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:38:58.048018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-69e7a642-ceda-4144-9d2a-9a6b6416b908 None None] MFA Rules not processed for user `0db58e38f88a4965a94d51882db44960`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:38:58.049395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-69e7a642-ceda-4144-9d2a-9a6b6416b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:38:58.060525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1088/2163] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:38:58 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:00.333747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:00.335144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:00.348724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2d3a-c25a-4005-9f79-c19843472134 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:00.364347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:00.364347 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:00.364685 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:00.365061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] PATH_INFO: `/v3/users/398517fd6a1248d4b868716965811739` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:00.366533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] RBAC: Authorizing `identity:delete_user(user_id=398517fd6a1248d4b868716965811739)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:00.368641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:00.427698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398517fd6a1248d4b868716965811739'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:00.440591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398517fd6a1248d4b868716965811739'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:00.441292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398517fd6a1248d4b868716965811739'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:00.448484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398517fd6a1248d4b868716965811739'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:00.449383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398517fd6a1248d4b868716965811739'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:00.461221 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1076/2164] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:39:00 2021] DELETE /identity/v3/users/398517fd6a1248d4b868716965811739 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:39:00.465773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78af39d-06a3-4da3-9315-27719e399c02 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:00.466255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78af39d-06a3-4da3-9315-27719e399c02 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:00.466347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78af39d-06a3-4da3-9315-27719e399c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:00.484975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f78af39d-06a3-4da3-9315-27719e399c02 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:00.486137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f78af39d-06a3-4da3-9315-27719e399c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:00.547132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1089/2165] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:00.557056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:00.559280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:00.614506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aa281-7654-465c-b24d-dd88d754d62a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:00.617982 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ce006-4101-4a6a-a2e0-61d14f442d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:00.618733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce006-4101-4a6a-a2e0-61d14f442d99 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:00.619012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce006-4101-4a6a-a2e0-61d14f442d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:00.619282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce006-4101-4a6a-a2e0-61d14f442d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:00.630080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ce006-4101-4a6a-a2e0-61d14f442d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:00.631698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ce006-4101-4a6a-a2e0-61d14f442d99 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:00.641090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1077/2166] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:39:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:39:01.164986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78af39d-06a3-4da3-9315-27719e399c02 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:01.166887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f78af39d-06a3-4da3-9315-27719e399c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:01.189458 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78af39d-06a3-4da3-9315-27719e399c02 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:01.200464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:01.202492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.202965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.203426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] PATH_INFO: `/v3/projects/278c13336de14a378d7ce3d771396645` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.205067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=278c13336de14a378d7ce3d771396645)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:01.207687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:01.295975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278c13336de14a378d7ce3d771396645', 'request_id': 'req-2ef4f46f-f8e6-4046-8ecc-616280adc84c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:01.302667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278c13336de14a378d7ce3d771396645', 'request_id': 'req-2ef4f46f-f8e6-4046-8ecc-616280adc84c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:01.313940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278c13336de14a378d7ce3d771396645', 'request_id': 'req-2ef4f46f-f8e6-4046-8ecc-616280adc84c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:01.330061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] The token cache is being invalidate because project 278c13336de14a378d7ce3d771396645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:39:01.330350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:01.331722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2ef4f46f-f8e6-4046-8ecc-616280adc84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:01.334060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1090/2167] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:39:01 2021] DELETE /identity/v3/projects/278c13336de14a378d7ce3d771396645 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:39:01.349920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfe3a-a570-42e7-85d7-efba186f6133 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.350602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfe3a-a570-42e7-85d7-efba186f6133 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.350964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfe3a-a570-42e7-85d7-efba186f6133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.378694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-644cfe3a-a570-42e7-85d7-efba186f6133 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:01.387264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-644cfe3a-a570-42e7-85d7-efba186f6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:01.490577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1078/2168] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:01.499347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e004e-7bb1-4c8f-8864-2f9142618643 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.500133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e004e-7bb1-4c8f-8864-2f9142618643 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.500482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e004e-7bb1-4c8f-8864-2f9142618643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.523563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-319e004e-7bb1-4c8f-8864-2f9142618643 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:01.525103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-319e004e-7bb1-4c8f-8864-2f9142618643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:01.533636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1091/2169] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:01.538319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cfe3a-a570-42e7-85d7-efba186f6133 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:01.552193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cfe3a-a570-42e7-85d7-efba186f6133 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:01.567960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:01.568736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.568990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.569274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.570071 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:39:01.570333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:01.572146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:01.604280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1079/2170] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:39:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:39:01.609571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e004e-7bb1-4c8f-8864-2f9142618643 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:01.637564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e004e-7bb1-4c8f-8864-2f9142618643 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:01.650887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86dc48-b6d6-4281-81d1-a1291fd259bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:01.651768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86dc48-b6d6-4281-81d1-a1291fd259bb admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.652172 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86dc48-b6d6-4281-81d1-a1291fd259bb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.652474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86dc48-b6d6-4281-81d1-a1291fd259bb admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.653242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86dc48-b6d6-4281-81d1-a1291fd259bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:01.655292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86dc48-b6d6-4281-81d1-a1291fd259bb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:01.723598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1092/2171] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:39:01 2021] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:39:01.728090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:01.739196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a33a0-e668-4361-976e-22797b75e35e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:01.810277 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719822e-135a-4875-8f82-7dafb90c2848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:01.811354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719822e-135a-4875-8f82-7dafb90c2848 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.811839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719822e-135a-4875-8f82-7dafb90c2848 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.812369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719822e-135a-4875-8f82-7dafb90c2848 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.813265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719822e-135a-4875-8f82-7dafb90c2848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:01.815973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719822e-135a-4875-8f82-7dafb90c2848 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:01.850395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1080/2172] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:39:01 2021] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:39:01.851669 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86dc48-b6d6-4281-81d1-a1291fd259bb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:01.863107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86dc48-b6d6-4281-81d1-a1291fd259bb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:01.875740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf265e9-06df-40a7-8936-262086e296ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:01.876547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf265e9-06df-40a7-8936-262086e296ca admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.876909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf265e9-06df-40a7-8936-262086e296ca admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.877407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf265e9-06df-40a7-8936-262086e296ca admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.878223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf265e9-06df-40a7-8936-262086e296ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:01.880126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf265e9-06df-40a7-8936-262086e296ca admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:01.892518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1093/2173] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:39:01 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:39:01.897199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719822e-135a-4875-8f82-7dafb90c2848 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:01.907904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719822e-135a-4875-8f82-7dafb90c2848 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:01.912821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50a9de-60d1-4af7-9f47-5bb617aee63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:01.913586 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a9de-60d1-4af7-9f47-5bb617aee63a admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.913946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a9de-60d1-4af7-9f47-5bb617aee63a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.914416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a9de-60d1-4af7-9f47-5bb617aee63a admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.915233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50a9de-60d1-4af7-9f47-5bb617aee63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:01.917016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50a9de-60d1-4af7-9f47-5bb617aee63a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:01.945397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf265e9-06df-40a7-8936-262086e296ca admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:01.945672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1081/2174] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:39:01 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:39:01.955766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf265e9-06df-40a7-8936-262086e296ca admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:01.960719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:01.961793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:01.962232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:01.962688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] PATH_INFO: `/v3/projects/dcfeb19e3a6d42cfbf29ba7e9a7aeacf/users/b539456ade66487fabf02e41879bbb45/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:01.978160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfeb19e3a6d42cfbf29ba7e9a7aeacf, user_id=b539456ade66487fabf02e41879bbb45, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:01.982142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:02.000197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1094/2175] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:39:01 2021] PUT /identity/v3/projects/dcfeb19e3a6d42cfbf29ba7e9a7aeacf/users/b539456ade66487fabf02e41879bbb45/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:39:02.008590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e919-552b-43bc-9f59-2406539bd370 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:02.008976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e919-552b-43bc-9f59-2406539bd370 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:02.010558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e919-552b-43bc-9f59-2406539bd370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:02.047887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1f75e919-552b-43bc-9f59-2406539bd370 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:02.049310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1f75e919-552b-43bc-9f59-2406539bd370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:02.164709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:02.164880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1082/2176] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:02.166432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:02.264682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe8b48-e982-4783-accf-f2551d3212ae admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:02.274197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24cfd8-1ff7-4cb2-8ca0-c7d7fc2d150d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:02.277875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cfd8-1ff7-4cb2-8ca0-c7d7fc2d150d service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:02.278318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cfd8-1ff7-4cb2-8ca0-c7d7fc2d150d service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:02.280263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cfd8-1ff7-4cb2-8ca0-c7d7fc2d150d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:02.294622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24cfd8-1ff7-4cb2-8ca0-c7d7fc2d150d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:02.296486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24cfd8-1ff7-4cb2-8ca0-c7d7fc2d150d service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:02.313814 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1095/2177] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:39:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:39:04.115649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112492-9cca-4181-8365-3d454587d209 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:04.116576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112492-9cca-4181-8365-3d454587d209 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:04.117015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112492-9cca-4181-8365-3d454587d209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:04.139327 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-15112492-9cca-4181-8365-3d454587d209 None None] MFA Rules not processed for user `f3ecf43d42c74783a82bf45afd8826e8`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:04.140975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-15112492-9cca-4181-8365-3d454587d209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:04.224549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1083/2178] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:04 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:39:09.327815 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a2180-6a17-40e3-8510-d415f1951c29 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:09.328327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a2180-6a17-40e3-8510-d415f1951c29 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:09.328435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a2180-6a17-40e3-8510-d415f1951c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:09.365123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-125a2180-6a17-40e3-8510-d415f1951c29 None None] MFA Rules not processed for user `b539456ade66487fabf02e41879bbb45`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:09.366367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-125a2180-6a17-40e3-8510-d415f1951c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:09.450906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1096/2179] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:09 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:09.455399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15112492-9cca-4181-8365-3d454587d209 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:09.466213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15112492-9cca-4181-8365-3d454587d209 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:09.471006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1e7a-38f7-45e3-8d51-3ca0c52ee5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:09.471774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1e7a-38f7-45e3-8d51-3ca0c52ee5ac admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:09.472127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1e7a-38f7-45e3-8d51-3ca0c52ee5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:09.472470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1e7a-38f7-45e3-8d51-3ca0c52ee5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:09.473230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1e7a-38f7-45e3-8d51-3ca0c52ee5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:09.475222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1e7a-38f7-45e3-8d51-3ca0c52ee5ac admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:09.509301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1084/2180] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:39:09 2021] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:39:09.513496 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a2180-6a17-40e3-8510-d415f1951c29 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:09.524034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a2180-6a17-40e3-8510-d415f1951c29 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:09.619321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafa7f4-17ca-410b-84e5-67797ecee366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:09.620128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa7f4-17ca-410b-84e5-67797ecee366 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:09.620447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa7f4-17ca-410b-84e5-67797ecee366 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:09.623625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa7f4-17ca-410b-84e5-67797ecee366 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:09.624955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafa7f4-17ca-410b-84e5-67797ecee366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:09.627109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafa7f4-17ca-410b-84e5-67797ecee366 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:09.654756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1097/2181] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:39:09 2021] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:39:09.658863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1e7a-38f7-45e3-8d51-3ca0c52ee5ac admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:09.670114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1e7a-38f7-45e3-8d51-3ca0c52ee5ac admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:09.674918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3685932-04ff-41bf-9e6f-3cfcf7fabbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:09.675381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685932-04ff-41bf-9e6f-3cfcf7fabbfe admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:09.675663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685932-04ff-41bf-9e6f-3cfcf7fabbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:09.675980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685932-04ff-41bf-9e6f-3cfcf7fabbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:09.676705 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3685932-04ff-41bf-9e6f-3cfcf7fabbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:09.678350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3685932-04ff-41bf-9e6f-3cfcf7fabbfe admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:09.701218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1085/2182] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:39:09 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:39:09.704962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafa7f4-17ca-410b-84e5-67797ecee366 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:09.715397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafa7f4-17ca-410b-84e5-67797ecee366 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:09.720473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17478864-d41b-4d4f-8687-537cf44b251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:09.721375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17478864-d41b-4d4f-8687-537cf44b251b admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:09.721660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17478864-d41b-4d4f-8687-537cf44b251b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:09.721939 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17478864-d41b-4d4f-8687-537cf44b251b admin admin] PATH_INFO: `/v3/projects/daa5767c8c514b27b56c92e463dbf2cc/users/8d690951a63449a4b967727eb2a188a3/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:09.741795 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17478864-d41b-4d4f-8687-537cf44b251b admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa5767c8c514b27b56c92e463dbf2cc, user_id=8d690951a63449a4b967727eb2a188a3, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:09.744958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17478864-d41b-4d4f-8687-537cf44b251b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:09.775805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1098/2183] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:39:09 2021] PUT /identity/v3/projects/daa5767c8c514b27b56c92e463dbf2cc/users/8d690951a63449a4b967727eb2a188a3/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:39:09.780077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3685932-04ff-41bf-9e6f-3cfcf7fabbfe admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:09.789859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3685932-04ff-41bf-9e6f-3cfcf7fabbfe admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:09.894712 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85895220-7b0d-42de-8ddc-f522930d4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:09.895391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895220-7b0d-42de-8ddc-f522930d4575 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:09.895673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895220-7b0d-42de-8ddc-f522930d4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:09.895984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895220-7b0d-42de-8ddc-f522930d4575 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:09.896845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85895220-7b0d-42de-8ddc-f522930d4575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:09.898569 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85895220-7b0d-42de-8ddc-f522930d4575 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:09.913631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1086/2184] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:39:09 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:39:09.914821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17478864-d41b-4d4f-8687-537cf44b251b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:09.926683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17478864-d41b-4d4f-8687-537cf44b251b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:09.932165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:09.934350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:09.934350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:09.934350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] PATH_INFO: `/v3/projects/daa5767c8c514b27b56c92e463dbf2cc/users/8d690951a63449a4b967727eb2a188a3/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:09.936160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa5767c8c514b27b56c92e463dbf2cc, user_id=8d690951a63449a4b967727eb2a188a3, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:09.938857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:09.950652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1099/2185] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:39:09 2021] PUT /identity/v3/projects/daa5767c8c514b27b56c92e463dbf2cc/users/8d690951a63449a4b967727eb2a188a3/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:39:16.459850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371445-5419-4a5e-bb8b-70c372f1ef0a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:16.460289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371445-5419-4a5e-bb8b-70c372f1ef0a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:16.460289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371445-5419-4a5e-bb8b-70c372f1ef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:16.492871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6d371445-5419-4a5e-bb8b-70c372f1ef0a None None] MFA Rules not processed for user `8d690951a63449a4b967727eb2a188a3`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:16.494237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6d371445-5419-4a5e-bb8b-70c372f1ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:16.592001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1087/2186] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:16 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:16.604827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:16.606760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:16.690595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83a29-bb9f-4515-9c06-216f32e5710b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:16.695585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21c2d2-5eb5-49c5-b8be-ed1e75618d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:16.696263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c2d2-5eb5-49c5-b8be-ed1e75618d01 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:16.696541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c2d2-5eb5-49c5-b8be-ed1e75618d01 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:16.696813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c2d2-5eb5-49c5-b8be-ed1e75618d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:16.751849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21c2d2-5eb5-49c5-b8be-ed1e75618d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:16.753362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21c2d2-5eb5-49c5-b8be-ed1e75618d01 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:16.762257 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1100/2187] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:39:16 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:39:18.196682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584079b-8d2f-4eb1-af6b-75a108192bb3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:18.197178 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584079b-8d2f-4eb1-af6b-75a108192bb3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:18.197268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584079b-8d2f-4eb1-af6b-75a108192bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:18.214808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-2584079b-8d2f-4eb1-af6b-75a108192bb3 None None] MFA Rules not processed for user `b539456ade66487fabf02e41879bbb45`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:18.216015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2584079b-8d2f-4eb1-af6b-75a108192bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:18.222797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1088/2188] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:21.137571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d46f98-c594-478a-a40c-06b36ed3e5b4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:21.138045 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d46f98-c594-478a-a40c-06b36ed3e5b4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:21.138124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d46f98-c594-478a-a40c-06b36ed3e5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:21.159171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-23d46f98-c594-478a-a40c-06b36ed3e5b4 None None] MFA Rules not processed for user `0db58e38f88a4965a94d51882db44960`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:21.160512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-23d46f98-c594-478a-a40c-06b36ed3e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:21.238246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1101/2189] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:21 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:27.235307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582878-e6f5-4a5c-a0dd-3591235e832f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:27.235862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582878-e6f5-4a5c-a0dd-3591235e832f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:27.235962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582878-e6f5-4a5c-a0dd-3591235e832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:27.280755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-0e582878-e6f5-4a5c-a0dd-3591235e832f None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:27.282036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0e582878-e6f5-4a5c-a0dd-3591235e832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:27.407999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1089/2190] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:39:27 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:27.473164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d46f98-c594-478a-a40c-06b36ed3e5b4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:27.474598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-23d46f98-c594-478a-a40c-06b36ed3e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:27.545851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d46f98-c594-478a-a40c-06b36ed3e5b4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:27.550527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1babc-babf-4600-a0c7-07968e1e3b0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:27.551171 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1babc-babf-4600-a0c7-07968e1e3b0c service swift] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:27.551455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1babc-babf-4600-a0c7-07968e1e3b0c service swift] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:27.551760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1babc-babf-4600-a0c7-07968e1e3b0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:27.559915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1babc-babf-4600-a0c7-07968e1e3b0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:27.561488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1babc-babf-4600-a0c7-07968e1e3b0c service swift] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:27.568826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1102/2191] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 03:39:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:30.317907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582878-e6f5-4a5c-a0dd-3591235e832f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:30.319990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0e582878-e6f5-4a5c-a0dd-3591235e832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:30.408220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582878-e6f5-4a5c-a0dd-3591235e832f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:30.416643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:30.419328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:30.419738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:30.421920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] PATH_INFO: `/v3/users/dcc8a44d19a949d2a865ecd257316de7` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:30.424783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc8a44d19a949d2a865ecd257316de7)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:30.427562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:30.481128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc8a44d19a949d2a865ecd257316de7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:30.498248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc8a44d19a949d2a865ecd257316de7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:30.498966 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc8a44d19a949d2a865ecd257316de7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:30.507283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc8a44d19a949d2a865ecd257316de7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:30.507942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc8a44d19a949d2a865ecd257316de7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:30.522177 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1090/2192] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:39:30 2021] DELETE /identity/v3/users/dcc8a44d19a949d2a865ecd257316de7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:39:30.526631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4090fc0-2568-4296-9b1e-8a44109e3b80 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:30.527165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4090fc0-2568-4296-9b1e-8a44109e3b80 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:30.527165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4090fc0-2568-4296-9b1e-8a44109e3b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:30.545221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d4090fc0-2568-4296-9b1e-8a44109e3b80 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:30.546671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d4090fc0-2568-4296-9b1e-8a44109e3b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:30.613579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1103/2193] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:39:30.625844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:30.627205 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:30.693961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aee00-e456-41ad-9eb5-292c1eda3d12 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:30.699977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51b677-c289-4d00-a73a-2b6f7a1e5260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:30.701385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51b677-c289-4d00-a73a-2b6f7a1e5260 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:30.701843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51b677-c289-4d00-a73a-2b6f7a1e5260 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:30.702123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51b677-c289-4d00-a73a-2b6f7a1e5260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:30.726534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51b677-c289-4d00-a73a-2b6f7a1e5260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:30.730495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51b677-c289-4d00-a73a-2b6f7a1e5260 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:30.741853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1091/2194] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:39:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:39:31.403211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4090fc0-2568-4296-9b1e-8a44109e3b80 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:31.405184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d4090fc0-2568-4296-9b1e-8a44109e3b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:31.440240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4090fc0-2568-4296-9b1e-8a44109e3b80 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:31.468361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:31.470043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:31.470340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:31.470620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] PATH_INFO: `/v3/projects/d39650a77ceb49bc9639eb1d4f578f05` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:31.471852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39650a77ceb49bc9639eb1d4f578f05)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:31.479081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:31.560315 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39650a77ceb49bc9639eb1d4f578f05', 'request_id': 'req-733bad48-236b-447f-8b41-c5dd858264f2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:31.580990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39650a77ceb49bc9639eb1d4f578f05', 'request_id': 'req-733bad48-236b-447f-8b41-c5dd858264f2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:31.600733 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39650a77ceb49bc9639eb1d4f578f05', 'request_id': 'req-733bad48-236b-447f-8b41-c5dd858264f2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:31.616432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] The token cache is being invalidate because project d39650a77ceb49bc9639eb1d4f578f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:39:31.617103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:31.617952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-733bad48-236b-447f-8b41-c5dd858264f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:39:31.629206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92672e-8be8-449e-a1ed-ca89fc43f429 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:31.629799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1104/2195] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:39:31 2021] DELETE /identity/v3/projects/d39650a77ceb49bc9639eb1d4f578f05 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:39:31.630312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92672e-8be8-449e-a1ed-ca89fc43f429 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:31.630744 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92672e-8be8-449e-a1ed-ca89fc43f429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:31.650831 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6c92672e-8be8-449e-a1ed-ca89fc43f429 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:31.652753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6c92672e-8be8-449e-a1ed-ca89fc43f429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:31.729501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1092/2196] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:39:31.738001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c3bb-645d-4917-85fe-706f572fee45 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:31.738715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c3bb-645d-4917-85fe-706f572fee45 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:31.739214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c3bb-645d-4917-85fe-706f572fee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:31.763495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2894c3bb-645d-4917-85fe-706f572fee45 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:31.765367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2894c3bb-645d-4917-85fe-706f572fee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:31.773508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1105/2197] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:31.779296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92672e-8be8-449e-a1ed-ca89fc43f429 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:31.789518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92672e-8be8-449e-a1ed-ca89fc43f429 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:31.796679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:31.797816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:31.798265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:31.798711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:31.799626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:39:31.799979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:31.801598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:31.820297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1093/2198] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:39:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:39:31.821739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894c3bb-645d-4917-85fe-706f572fee45 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:31.846659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894c3bb-645d-4917-85fe-706f572fee45 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:31.851778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680e409-ba59-4680-9385-63d8fec1012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:31.852452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680e409-ba59-4680-9385-63d8fec1012c admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:31.852732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680e409-ba59-4680-9385-63d8fec1012c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:31.853009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680e409-ba59-4680-9385-63d8fec1012c admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:31.853705 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680e409-ba59-4680-9385-63d8fec1012c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:31.856576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680e409-ba59-4680-9385-63d8fec1012c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:31.884121 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1106/2199] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:39:31 2021] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:39:31.888850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:31.903159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8c000-5098-4224-ac92-01fbffca88b2 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:31.989319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbba994-644a-4c88-b673-eb35d50cf3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:31.990179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbba994-644a-4c88-b673-eb35d50cf3ab admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:31.990472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbba994-644a-4c88-b673-eb35d50cf3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:31.990750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbba994-644a-4c88-b673-eb35d50cf3ab admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:31.991467 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbba994-644a-4c88-b673-eb35d50cf3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:31.994187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbba994-644a-4c88-b673-eb35d50cf3ab admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:32.022800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1094/2200] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:39:31 2021] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:39:32.027404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680e409-ba59-4680-9385-63d8fec1012c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:32.039213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680e409-ba59-4680-9385-63d8fec1012c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:32.045406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881bdef-80c3-49ec-bf9f-8b4668cf1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:32.046088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881bdef-80c3-49ec-bf9f-8b4668cf1383 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:32.046378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881bdef-80c3-49ec-bf9f-8b4668cf1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:32.046657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881bdef-80c3-49ec-bf9f-8b4668cf1383 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:32.047559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881bdef-80c3-49ec-bf9f-8b4668cf1383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:32.049223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881bdef-80c3-49ec-bf9f-8b4668cf1383 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:32.068907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbba994-644a-4c88-b673-eb35d50cf3ab admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:32.082106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1107/2201] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:39:32 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:39:32.090672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbba994-644a-4c88-b673-eb35d50cf3ab admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:32.096218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548a963-4024-4cfe-a4b8-5b1664034fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:32.097038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a963-4024-4cfe-a4b8-5b1664034fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:32.097329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a963-4024-4cfe-a4b8-5b1664034fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:32.097613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a963-4024-4cfe-a4b8-5b1664034fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:32.098442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548a963-4024-4cfe-a4b8-5b1664034fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:32.102975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548a963-4024-4cfe-a4b8-5b1664034fd8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:32.114999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1095/2202] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:39:32 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:39:32.119487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881bdef-80c3-49ec-bf9f-8b4668cf1383 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:32.132605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881bdef-80c3-49ec-bf9f-8b4668cf1383 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:32.146640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:32.147542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:32.147867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:32.148146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] PATH_INFO: `/v3/projects/55fad6251ff244ea9f24d160e444628f/users/5d6d5c2460744df9ba96e3d336e4747a/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:32.167663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fad6251ff244ea9f24d160e444628f, user_id=5d6d5c2460744df9ba96e3d336e4747a, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:32.170948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:32.190810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1108/2203] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:39:32 2021] PUT /identity/v3/projects/55fad6251ff244ea9f24d160e444628f/users/5d6d5c2460744df9ba96e3d336e4747a/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:39:32.196077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6e8f-b43d-417e-bc9a-5337156db213 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:32.196400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6e8f-b43d-417e-bc9a-5337156db213 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:32.196771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6e8f-b43d-417e-bc9a-5337156db213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:32.231506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-636d6e8f-b43d-417e-bc9a-5337156db213 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:32.232808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-636d6e8f-b43d-417e-bc9a-5337156db213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:32.305695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1096/2204] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:32.316454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:32.318627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:32.393956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400d2f-3f7f-4d85-941d-e18847d1440a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:32.398221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:32.399101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:32.399556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:32.400048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:32.410737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:32.413103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:32.428640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1109/2205] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:39:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:39:33.524533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d867-a48e-4fee-aa2c-26f47bd73604 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:33.525519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d867-a48e-4fee-aa2c-26f47bd73604 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:33.525519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d867-a48e-4fee-aa2c-26f47bd73604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:33.568443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c088d867-a48e-4fee-aa2c-26f47bd73604 None None] MFA Rules not processed for user `5d6d5c2460744df9ba96e3d336e4747a`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:33.570311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c088d867-a48e-4fee-aa2c-26f47bd73604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:33.803626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1097/2206] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:33 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:33.814206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:33.816227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:34.103470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c62a42-81d5-4c33-be10-879f56708536 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:34.121750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8aae7-9129-45aa-98ca-89550a7cba63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:34.122436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8aae7-9129-45aa-98ca-89550a7cba63 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:34.122717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8aae7-9129-45aa-98ca-89550a7cba63 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:34.122992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8aae7-9129-45aa-98ca-89550a7cba63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:34.180660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8aae7-9129-45aa-98ca-89550a7cba63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:34.182365 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8aae7-9129-45aa-98ca-89550a7cba63 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:34.194691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1110/2207] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:39:33 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:39:35.748314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8a0e7-30b5-4e0b-8de3-d597ae60cf24 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:35.757353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8a0e7-30b5-4e0b-8de3-d597ae60cf24 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:35.757663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8a0e7-30b5-4e0b-8de3-d597ae60cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:35.795986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d5e8a0e7-30b5-4e0b-8de3-d597ae60cf24 None None] MFA Rules not processed for user `5d6d5c2460744df9ba96e3d336e4747a`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:35.797194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d5e8a0e7-30b5-4e0b-8de3-d597ae60cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:35.817640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1098/2208] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:39:35 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:45.240700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bca2-9c62-4465-8317-3681c97700dc None None] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:45.241295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bca2-9c62-4465-8317-3681c97700dc None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:45.241295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bca2-9c62-4465-8317-3681c97700dc None None] PATH_INFO: `/` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:45.243051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1111/2209] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:39:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:39:45.248881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b06a5-a067-43d0-8aa7-2a50cfc7ef24 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:45.249344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b06a5-a067-43d0-8aa7-2a50cfc7ef24 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:45.249475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b06a5-a067-43d0-8aa7-2a50cfc7ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:45.267160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ce9b06a5-a067-43d0-8aa7-2a50cfc7ef24 None None] MFA Rules not processed for user `dbe34d9bb0994e7f80044be0a373ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:45.268379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ce9b06a5-a067-43d0-8aa7-2a50cfc7ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:45.335256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1099/2210] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:39:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:45.348834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77bca2-9c62-4465-8317-3681c97700dc None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:45.350560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ec77bca2-9c62-4465-8317-3681c97700dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:45.405579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77bca2-9c62-4465-8317-3681c97700dc None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:45.409173 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0186-eb6f-4994-8981-b140f92c8153 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:45.409823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0186-eb6f-4994-8981-b140f92c8153 service glance] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:45.410105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0186-eb6f-4994-8981-b140f92c8153 service glance] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:45.410380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0186-eb6f-4994-8981-b140f92c8153 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:45.420533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e0186-eb6f-4994-8981-b140f92c8153 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:45.421959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e0186-eb6f-4994-8981-b140f92c8153 service glance] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:45.431767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1112/2211] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:39:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:39:45.501968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65a43-c6c7-4b77-ac8f-eaad2bd5af3d None None] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:45.502313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65a43-c6c7-4b77-ac8f-eaad2bd5af3d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:45.502592 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c65a43-c6c7-4b77-ac8f-eaad2bd5af3d None None] PATH_INFO: `/` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:45.504433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1100/2212] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 28 03:39:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:39:45.509671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caada8-5874-41b1-912b-e8c45c0c9df1 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:45.509963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caada8-5874-41b1-912b-e8c45c0c9df1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:45.510773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caada8-5874-41b1-912b-e8c45c0c9df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:45.528500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-23caada8-5874-41b1-912b-e8c45c0c9df1 None None] MFA Rules not processed for user `78279cb4fa504d18943cd8807b674cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:45.529859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-23caada8-5874-41b1-912b-e8c45c0c9df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:45.536531 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1113/2213] 10.222.0.16 () {58 vars in 1019 bytes} [Wed Jul 28 03:39:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:45.548807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c65a43-c6c7-4b77-ac8f-eaad2bd5af3d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:45.550469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-59c65a43-c6c7-4b77-ac8f-eaad2bd5af3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:45.563155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c65a43-c6c7-4b77-ac8f-eaad2bd5af3d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:45.566801 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:45.567500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:45.567820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:45.568120 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:45.576027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:45.577462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:45.585525 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1101/2214] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:39:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:39:49.391564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5d2a-e7ff-447b-b434-9415a86795d6 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:49.392132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5d2a-e7ff-447b-b434-9415a86795d6 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:49.392132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5d2a-e7ff-447b-b434-9415a86795d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:49.411083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-728d5d2a-e7ff-447b-b434-9415a86795d6 None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:49.412379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-728d5d2a-e7ff-447b-b434-9415a86795d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:49.518187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1114/2215] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:39:49 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:49.527937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:49.529394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:49.610834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5c98c-8172-4d38-ba6e-a06b7dbc8914 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:49.616232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7280-dcc4-49c9-8cee-3af40c665cf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:49.616855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7280-dcc4-49c9-8cee-3af40c665cf6 service swift] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:49.617121 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7280-dcc4-49c9-8cee-3af40c665cf6 service swift] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:49.617924 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7280-dcc4-49c9-8cee-3af40c665cf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:49.626909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac7280-dcc4-49c9-8cee-3af40c665cf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:49.629455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac7280-dcc4-49c9-8cee-3af40c665cf6 service swift] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:49.654411 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1102/2216] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 03:39:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 03:39:52.458921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ecfe-6e03-48ad-9a4e-acbb09b4f09e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:52.459476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ecfe-6e03-48ad-9a4e-acbb09b4f09e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:52.459476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ecfe-6e03-48ad-9a4e-acbb09b4f09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:52.482753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-bfc0ecfe-6e03-48ad-9a4e-acbb09b4f09e None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:39:52.484566 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bfc0ecfe-6e03-48ad-9a4e-acbb09b4f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:39:52.500090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1115/2217] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 03:39:52 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:39:52.520281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7280-dcc4-49c9-8cee-3af40c665cf6 service swift] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:39:52.537515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7280-dcc4-49c9-8cee-3af40c665cf6 service swift] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:39:52.547598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6f1e-5290-48f6-a706-5270c437ea62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:39:52.548532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6f1e-5290-48f6-a706-5270c437ea62 service swift] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:39:52.549466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6f1e-5290-48f6-a706-5270c437ea62 service swift] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:39:52.549889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6f1e-5290-48f6-a706-5270c437ea62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:39:52.565693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c6f1e-5290-48f6-a706-5270c437ea62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:39:52.568168 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c6f1e-5290-48f6-a706-5270c437ea62 service swift] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:39:52.591369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1103/2218] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 03:39:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:08.124027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df555-d2e0-4104-af4f-ba5d9a48a12c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:08.124552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df555-d2e0-4104-af4f-ba5d9a48a12c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:08.124707 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df555-d2e0-4104-af4f-ba5d9a48a12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:08.150306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-666df555-d2e0-4104-af4f-ba5d9a48a12c None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:08.151438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-666df555-d2e0-4104-af4f-ba5d9a48a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:08.176698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1116/2219] 10.222.0.16 () {58 vars in 968 bytes} [Wed Jul 28 03:40:08 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:08.190136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6f1e-5290-48f6-a706-5270c437ea62 service swift] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:08.233761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6f1e-5290-48f6-a706-5270c437ea62 service swift] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:08.238547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550e048-b880-4ef8-a79b-49594a9ed073 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:08.239185 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e048-b880-4ef8-a79b-49594a9ed073 service swift] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:08.239463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e048-b880-4ef8-a79b-49594a9ed073 service swift] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:08.239760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e048-b880-4ef8-a79b-49594a9ed073 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:08.248296 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550e048-b880-4ef8-a79b-49594a9ed073 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:08.249886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550e048-b880-4ef8-a79b-49594a9ed073 service swift] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:08.258422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1104/2220] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 03:40:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 03:40:10.375829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df555-d2e0-4104-af4f-ba5d9a48a12c None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:10.377346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-666df555-d2e0-4104-af4f-ba5d9a48a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:10.424287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df555-d2e0-4104-af4f-ba5d9a48a12c None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:10.428583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:10.429443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:10.429719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:10.429989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] PATH_INFO: `/v3/users/0db58e38f88a4965a94d51882db44960` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:10.431126 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db58e38f88a4965a94d51882db44960)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:10.433598 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:10.481662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db58e38f88a4965a94d51882db44960'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.493385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db58e38f88a4965a94d51882db44960'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.500577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db58e38f88a4965a94d51882db44960'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.501288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db58e38f88a4965a94d51882db44960'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.508481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db58e38f88a4965a94d51882db44960'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.515157 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1117/2221] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:10 2021] DELETE /identity/v3/users/0db58e38f88a4965a94d51882db44960 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:10.680877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550e048-b880-4ef8-a79b-49594a9ed073 service swift] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:10.691668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550e048-b880-4ef8-a79b-49594a9ed073 service swift] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:10.757601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:10.758363 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:10.758643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:10.758915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] PATH_INFO: `/v3/projects/390a8b33f669478db43fb9ad4259eccb` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:10.760827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390a8b33f669478db43fb9ad4259eccb)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:10.762809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:10.809818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390a8b33f669478db43fb9ad4259eccb', 'request_id': 'req-0f51914f-549c-46df-bd5b-02880c8bdac0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.816016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390a8b33f669478db43fb9ad4259eccb', 'request_id': 'req-0f51914f-549c-46df-bd5b-02880c8bdac0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.824780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390a8b33f669478db43fb9ad4259eccb', 'request_id': 'req-0f51914f-549c-46df-bd5b-02880c8bdac0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.835504 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] The token cache is being invalidate because project 390a8b33f669478db43fb9ad4259eccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:10.835825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.836696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:10.841489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1105/2222] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:10 2021] DELETE /identity/v3/projects/390a8b33f669478db43fb9ad4259eccb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:17.248803 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:17.250251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:17.336364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d7fd-7b5d-46e6-b0f0-65adb7c7fa9e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:17.388699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:17.389361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:17.390221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:17.390535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:17.392718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:17.464401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:17.465853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:17.475065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1118/2223] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:17 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:18.030226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:18.032479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:18.104314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51914f-549c-46df-bd5b-02880c8bdac0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:18.109126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:18.110007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:18.110291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:18.110563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] PATH_INFO: `/v3/users/f3ecf43d42c74783a82bf45afd8826e8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:18.111724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ecf43d42c74783a82bf45afd8826e8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:18.113721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:18.166370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ecf43d42c74783a82bf45afd8826e8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.178828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ecf43d42c74783a82bf45afd8826e8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.179563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ecf43d42c74783a82bf45afd8826e8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.187460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ecf43d42c74783a82bf45afd8826e8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.188085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-414dc71a-6251-429d-aee4-7d9f292c635e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ecf43d42c74783a82bf45afd8826e8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.200993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1106/2224] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:18 2021] DELETE /identity/v3/users/f3ecf43d42c74783a82bf45afd8826e8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:18.401163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:18.413848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2dd7a-318b-48ef-a4cd-364779a566bb service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:18.486639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:18.487511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:18.487830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:18.488111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] PATH_INFO: `/v3/projects/da239fd2931445e6be6459a0225fbd85` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:18.489255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=da239fd2931445e6be6459a0225fbd85)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:18.491170 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:18.540525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da239fd2931445e6be6459a0225fbd85', 'request_id': 'req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.549127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da239fd2931445e6be6459a0225fbd85', 'request_id': 'req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.558584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da239fd2931445e6be6459a0225fbd85', 'request_id': 'req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.569082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] The token cache is being invalidate because project da239fd2931445e6be6459a0225fbd85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:18.569378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.570010 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bdf7a2aa-b222-41d6-9aff-6d3a3ba6c2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:18.572116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1119/2225] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:18 2021] DELETE /identity/v3/projects/da239fd2931445e6be6459a0225fbd85 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:18.577796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecc2b-4fbe-4297-9c04-9c4aa4d7e8b1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:18.578084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecc2b-4fbe-4297-9c04-9c4aa4d7e8b1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:18.578407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecc2b-4fbe-4297-9c04-9c4aa4d7e8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:18.634151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-98eecc2b-4fbe-4297-9c04-9c4aa4d7e8b1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:18.635365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-98eecc2b-4fbe-4297-9c04-9c4aa4d7e8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:18.697155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1107/2226] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:40:18.705366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7e203-d28f-4f2a-a41c-9747ebb76fad None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:18.705652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7e203-d28f-4f2a-a41c-9747ebb76fad None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:18.705936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7e203-d28f-4f2a-a41c-9747ebb76fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:18.725222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-4fc7e203-d28f-4f2a-a41c-9747ebb76fad None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:18.726401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4fc7e203-d28f-4f2a-a41c-9747ebb76fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:18.735102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1120/2227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:18.739379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eecc2b-4fbe-4297-9c04-9c4aa4d7e8b1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:18.748784 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eecc2b-4fbe-4297-9c04-9c4aa4d7e8b1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:18.757006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:18.757910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:18.758295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:18.758700 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:18.759610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:40:18.760040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:18.762370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:18.777002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1108/2228] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:40:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:40:18.781047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7e203-d28f-4f2a-a41c-9747ebb76fad None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:18.790421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7e203-d28f-4f2a-a41c-9747ebb76fad None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:18.796866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f65399-008b-46e8-bbac-1a64a6635aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:18.798323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65399-008b-46e8-bbac-1a64a6635aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:18.798750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65399-008b-46e8-bbac-1a64a6635aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:18.799136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65399-008b-46e8-bbac-1a64a6635aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:18.800546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f65399-008b-46e8-bbac-1a64a6635aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:18.802048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f65399-008b-46e8-bbac-1a64a6635aa6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:18.835639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1121/2229] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:18 2021] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:18.840303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:18.850802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5aaa4-8690-4ebd-bd2c-a4c86d954b46 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:18.917643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01edb4-4a61-4bae-8771-e55dc46538b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:18.920384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01edb4-4a61-4bae-8771-e55dc46538b3 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:18.923352 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01edb4-4a61-4bae-8771-e55dc46538b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:18.923831 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01edb4-4a61-4bae-8771-e55dc46538b3 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:18.924480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01edb4-4a61-4bae-8771-e55dc46538b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:18.926501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01edb4-4a61-4bae-8771-e55dc46538b3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:18.946774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1109/2230] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:18 2021] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:18.950660 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f65399-008b-46e8-bbac-1a64a6635aa6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:18.960929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f65399-008b-46e8-bbac-1a64a6635aa6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:18.967543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a1d34-e2b1-4cb9-be9c-de83e1888d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:18.968325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a1d34-e2b1-4cb9-be9c-de83e1888d43 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:18.968612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a1d34-e2b1-4cb9-be9c-de83e1888d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:18.968923 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a1d34-e2b1-4cb9-be9c-de83e1888d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:18.969617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a1d34-e2b1-4cb9-be9c-de83e1888d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:18.971517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a1d34-e2b1-4cb9-be9c-de83e1888d43 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:18.984113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1122/2231] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:18.987890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01edb4-4a61-4bae-8771-e55dc46538b3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:19.000910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01edb4-4a61-4bae-8771-e55dc46538b3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:19.005945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c807f5a-1254-4731-b630-af482dfec524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:19.006696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807f5a-1254-4731-b630-af482dfec524 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:19.007054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807f5a-1254-4731-b630-af482dfec524 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:19.007553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807f5a-1254-4731-b630-af482dfec524 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:19.008374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c807f5a-1254-4731-b630-af482dfec524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:19.010953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c807f5a-1254-4731-b630-af482dfec524 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:19.026028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1110/2232] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:18 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:19.029426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a1d34-e2b1-4cb9-be9c-de83e1888d43 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:19.041970 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a1d34-e2b1-4cb9-be9c-de83e1888d43 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:19.047585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:19.049265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:19.049265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:19.049504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] PATH_INFO: `/v3/projects/4891767b43ac470d8256b29b6be2f6f2/users/483a98077a8f41ed97bb08922a1e11a1/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:19.067475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4891767b43ac470d8256b29b6be2f6f2, user_id=483a98077a8f41ed97bb08922a1e11a1, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:19.070107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:19.096241 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1123/2233] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:19 2021] PUT /identity/v3/projects/4891767b43ac470d8256b29b6be2f6f2/users/483a98077a8f41ed97bb08922a1e11a1/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:19.107441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403b1f8-743c-4907-a040-b76ca37d78bf None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:19.108525 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403b1f8-743c-4907-a040-b76ca37d78bf None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:19.108828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403b1f8-743c-4907-a040-b76ca37d78bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:19.164473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a403b1f8-743c-4907-a040-b76ca37d78bf None None] MFA Rules not processed for user `483a98077a8f41ed97bb08922a1e11a1`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:19.165699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a403b1f8-743c-4907-a040-b76ca37d78bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:19.277295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1111/2234] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:19 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:19.321021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:19.323426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:19.405549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5233fc8-b792-4b36-b92a-f39275d25b97 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:19.410886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:19.411619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:19.412005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:19.412354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:19.421124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:19.422837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:19.431950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1124/2235] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:19 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:25.682179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f381737-84c3-4bf5-b161-74c9b3a98416 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:25.682630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f381737-84c3-4bf5-b161-74c9b3a98416 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:25.682934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f381737-84c3-4bf5-b161-74c9b3a98416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:25.710869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-4f381737-84c3-4bf5-b161-74c9b3a98416 None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:25.712169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4f381737-84c3-4bf5-b161-74c9b3a98416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:25.778489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1112/2236] 10.222.0.16 () {58 vars in 968 bytes} [Wed Jul 28 03:40:25 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:25.791595 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:25.793337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:25.858441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119348c-fa89-4673-ae58-95f5a7e1b78d service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:25.863150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b481-d444-4556-a770-abb517f09f61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:25.863827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b481-d444-4556-a770-abb517f09f61 service swift] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:25.864114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b481-d444-4556-a770-abb517f09f61 service swift] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:25.864390 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b481-d444-4556-a770-abb517f09f61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:25.874621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b481-d444-4556-a770-abb517f09f61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:25.876301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b481-d444-4556-a770-abb517f09f61 service swift] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:25.885135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1125/2237] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 03:40:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:27.763841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f381737-84c3-4bf5-b161-74c9b3a98416 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:27.822951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f381737-84c3-4bf5-b161-74c9b3a98416 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:27.827946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:27.828796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:27.829073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:27.829342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] PATH_INFO: `/v3/users/483a98077a8f41ed97bb08922a1e11a1` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:27.830606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=483a98077a8f41ed97bb08922a1e11a1)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:27.832544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:27.875911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483a98077a8f41ed97bb08922a1e11a1'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:27.888099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483a98077a8f41ed97bb08922a1e11a1'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:27.888805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483a98077a8f41ed97bb08922a1e11a1'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:27.896469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483a98077a8f41ed97bb08922a1e11a1'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:27.897370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483a98077a8f41ed97bb08922a1e11a1'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:27.910871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1113/2238] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:27 2021] DELETE /identity/v3/users/483a98077a8f41ed97bb08922a1e11a1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:27.916030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677e92-24ae-49d1-9798-585955b46976 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:27.916576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677e92-24ae-49d1-9798-585955b46976 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:27.916967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677e92-24ae-49d1-9798-585955b46976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:27.943891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3b677e92-24ae-49d1-9798-585955b46976 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:27.945082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3b677e92-24ae-49d1-9798-585955b46976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:28.000223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1126/2239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:28.009922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:28.011970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:28.066323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdcb93-c7c9-4491-86cf-e5486cc7b13a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:28.069882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36705a-bf0a-4912-a59f-9febac2080e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:28.070522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36705a-bf0a-4912-a59f-9febac2080e7 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.070805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36705a-bf0a-4912-a59f-9febac2080e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.071081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36705a-bf0a-4912-a59f-9febac2080e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.080706 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36705a-bf0a-4912-a59f-9febac2080e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:28.082339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36705a-bf0a-4912-a59f-9febac2080e7 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:28.092444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1114/2240] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:28.371307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b677e92-24ae-49d1-9798-585955b46976 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:28.372692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3b677e92-24ae-49d1-9798-585955b46976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:28.383736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b677e92-24ae-49d1-9798-585955b46976 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:28.389486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:28.390336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.390611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.390880 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] PATH_INFO: `/v3/projects/4891767b43ac470d8256b29b6be2f6f2` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.392100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4891767b43ac470d8256b29b6be2f6f2)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:28.394029 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:28.438319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4891767b43ac470d8256b29b6be2f6f2', 'request_id': 'req-d5b99734-61b0-42eb-89d8-0babd15eb315'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:28.444734 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4891767b43ac470d8256b29b6be2f6f2', 'request_id': 'req-d5b99734-61b0-42eb-89d8-0babd15eb315'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:28.452433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4891767b43ac470d8256b29b6be2f6f2', 'request_id': 'req-d5b99734-61b0-42eb-89d8-0babd15eb315'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:28.462154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] The token cache is being invalidate because project 4891767b43ac470d8256b29b6be2f6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:28.462437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:28.463054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-d5b99734-61b0-42eb-89d8-0babd15eb315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:28.464619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1127/2241] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:28 2021] DELETE /identity/v3/projects/4891767b43ac470d8256b29b6be2f6f2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:28.470466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c9f5-5e65-4ece-982e-7d804fa8b327 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.470782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c9f5-5e65-4ece-982e-7d804fa8b327 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.471056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c9f5-5e65-4ece-982e-7d804fa8b327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.488278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3e83c9f5-5e65-4ece-982e-7d804fa8b327 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:28.489421 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3e83c9f5-5e65-4ece-982e-7d804fa8b327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:28.547802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1115/2242] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:28.556461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a01b9-6ac8-41be-9c24-0e00e5fb30c2 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.556751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a01b9-6ac8-41be-9c24-0e00e5fb30c2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.557036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a01b9-6ac8-41be-9c24-0e00e5fb30c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.575870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-348a01b9-6ac8-41be-9c24-0e00e5fb30c2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:28.577060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-348a01b9-6ac8-41be-9c24-0e00e5fb30c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:28.584309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1128/2243] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:28.588400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83c9f5-5e65-4ece-982e-7d804fa8b327 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:28.597758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83c9f5-5e65-4ece-982e-7d804fa8b327 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:28.602044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:28.602691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.602973 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.603249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.604028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:40:28.604337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:28.606093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:28.617289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1116/2244] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:40:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:40:28.622056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a01b9-6ac8-41be-9c24-0e00e5fb30c2 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:28.630466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a01b9-6ac8-41be-9c24-0e00e5fb30c2 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:28.634861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6563b-7300-4844-aad3-1fdf76dc2d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:28.635498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6563b-7300-4844-aad3-1fdf76dc2d94 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.636437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6563b-7300-4844-aad3-1fdf76dc2d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.636920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6563b-7300-4844-aad3-1fdf76dc2d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.637640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6563b-7300-4844-aad3-1fdf76dc2d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:28.639546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6563b-7300-4844-aad3-1fdf76dc2d94 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:28.663612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1129/2245] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:28 2021] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:28.667696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:28.676875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3da24-f6ec-4031-a967-932589534fef admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:28.738366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183b82a-6be7-468c-bfe7-2a2f054ff4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:28.739040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183b82a-6be7-468c-bfe7-2a2f054ff4af admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.739322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183b82a-6be7-468c-bfe7-2a2f054ff4af admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.739598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183b82a-6be7-468c-bfe7-2a2f054ff4af admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.740356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183b82a-6be7-468c-bfe7-2a2f054ff4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:28.742704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183b82a-6be7-468c-bfe7-2a2f054ff4af admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:28.766548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1117/2246] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:28 2021] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:28.767764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6563b-7300-4844-aad3-1fdf76dc2d94 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:28.777894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6563b-7300-4844-aad3-1fdf76dc2d94 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:28.782476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf2e92-3517-46cb-b91b-5063b5372bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:28.783137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2e92-3517-46cb-b91b-5063b5372bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.783416 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2e92-3517-46cb-b91b-5063b5372bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.783689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2e92-3517-46cb-b91b-5063b5372bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.784430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf2e92-3517-46cb-b91b-5063b5372bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:28.786016 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf2e92-3517-46cb-b91b-5063b5372bd8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:28.797608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1130/2247] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:40:28.801585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183b82a-6be7-468c-bfe7-2a2f054ff4af admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:28.812091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183b82a-6be7-468c-bfe7-2a2f054ff4af admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:28.816452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec825c36-036f-489b-ad73-5d7a10465010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:28.817133 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec825c36-036f-489b-ad73-5d7a10465010 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.817411 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec825c36-036f-489b-ad73-5d7a10465010 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.817682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec825c36-036f-489b-ad73-5d7a10465010 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.818400 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec825c36-036f-489b-ad73-5d7a10465010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:28.820050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec825c36-036f-489b-ad73-5d7a10465010 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:28.830716 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1118/2248] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:40:28.834449 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf2e92-3517-46cb-b91b-5063b5372bd8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:28.844484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf2e92-3517-46cb-b91b-5063b5372bd8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:28.849159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a2af-9502-449c-aba4-e2074c0cb957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:28.850224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a2af-9502-449c-aba4-e2074c0cb957 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.850526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a2af-9502-449c-aba4-e2074c0cb957 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.850834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a2af-9502-449c-aba4-e2074c0cb957 admin admin] PATH_INFO: `/v3/projects/d41cabf4afe14f35abc143dda1255700/users/0fa10b272d264c8a93aeb5edb3191e30/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.864910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57a2af-9502-449c-aba4-e2074c0cb957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41cabf4afe14f35abc143dda1255700, user_id=0fa10b272d264c8a93aeb5edb3191e30, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:28.867535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57a2af-9502-449c-aba4-e2074c0cb957 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:28.879641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1131/2249] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:28 2021] PUT /identity/v3/projects/d41cabf4afe14f35abc143dda1255700/users/0fa10b272d264c8a93aeb5edb3191e30/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:28.890582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3ce5-1462-47cf-898c-43dfc4877244 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:28.890880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3ce5-1462-47cf-898c-43dfc4877244 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:28.891184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3ce5-1462-47cf-898c-43dfc4877244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:28.918282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e66b3ce5-1462-47cf-898c-43dfc4877244 None None] MFA Rules not processed for user `0fa10b272d264c8a93aeb5edb3191e30`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:28.919435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e66b3ce5-1462-47cf-898c-43dfc4877244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:28.983976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1119/2250] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:28 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:28.988303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a2af-9502-449c-aba4-e2074c0cb957 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.046526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a2af-9502-449c-aba4-e2074c0cb957 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.050885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc870-2ad8-4890-9950-29140a41f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.051529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc870-2ad8-4890-9950-29140a41f2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.051836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc870-2ad8-4890-9950-29140a41f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.052111 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc870-2ad8-4890-9950-29140a41f2e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.052794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bc870-2ad8-4890-9950-29140a41f2e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.054667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bc870-2ad8-4890-9950-29140a41f2e8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.078065 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1132/2251] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:28 2021] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:29.082237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b3ce5-1462-47cf-898c-43dfc4877244 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.092794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b3ce5-1462-47cf-898c-43dfc4877244 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.155054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee09532-fd92-49c6-baca-7d3fe4df09e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.155769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee09532-fd92-49c6-baca-7d3fe4df09e4 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.156060 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee09532-fd92-49c6-baca-7d3fe4df09e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.156334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee09532-fd92-49c6-baca-7d3fe4df09e4 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.157035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee09532-fd92-49c6-baca-7d3fe4df09e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.158951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee09532-fd92-49c6-baca-7d3fe4df09e4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.178905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1120/2252] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:29 2021] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:40:29.183097 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc870-2ad8-4890-9950-29140a41f2e8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.192682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc870-2ad8-4890-9950-29140a41f2e8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.197282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1e2f1-d234-4f82-8dbf-3723c8640491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.197941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1e2f1-d234-4f82-8dbf-3723c8640491 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.198403 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1e2f1-d234-4f82-8dbf-3723c8640491 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.198756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1e2f1-d234-4f82-8dbf-3723c8640491 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.199479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1e2f1-d234-4f82-8dbf-3723c8640491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.201109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1e2f1-d234-4f82-8dbf-3723c8640491 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.211398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1133/2253] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:29.215817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee09532-fd92-49c6-baca-7d3fe4df09e4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.225161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee09532-fd92-49c6-baca-7d3fe4df09e4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.230218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827c821-141d-40ac-b9c9-fd79b76a5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.231083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827c821-141d-40ac-b9c9-fd79b76a5f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.231364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827c821-141d-40ac-b9c9-fd79b76a5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.231639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827c821-141d-40ac-b9c9-fd79b76a5f6d admin admin] PATH_INFO: `/v3/projects/576e452d50d14d4ea03aac77c855d430/users/1d98e16d93d147f5927b6dab00efda94/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.245743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827c821-141d-40ac-b9c9-fd79b76a5f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=576e452d50d14d4ea03aac77c855d430, user_id=1d98e16d93d147f5927b6dab00efda94, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.248431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827c821-141d-40ac-b9c9-fd79b76a5f6d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.261522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1121/2254] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:29 2021] PUT /identity/v3/projects/576e452d50d14d4ea03aac77c855d430/users/1d98e16d93d147f5927b6dab00efda94/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:29.265545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1e2f1-d234-4f82-8dbf-3723c8640491 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.274559 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1e2f1-d234-4f82-8dbf-3723c8640491 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.327760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1882a-a92d-4919-a56b-bb602e0c1550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.328407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1882a-a92d-4919-a56b-bb602e0c1550 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.328687 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1882a-a92d-4919-a56b-bb602e0c1550 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.328957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1882a-a92d-4919-a56b-bb602e0c1550 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.329659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1882a-a92d-4919-a56b-bb602e0c1550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.331232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1882a-a92d-4919-a56b-bb602e0c1550 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.341093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1134/2255] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:29 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:40:29.345061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827c821-141d-40ac-b9c9-fd79b76a5f6d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.355960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827c821-141d-40ac-b9c9-fd79b76a5f6d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.360271 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.361130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.361409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.361681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] PATH_INFO: `/v3/projects/576e452d50d14d4ea03aac77c855d430/users/1d98e16d93d147f5927b6dab00efda94/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.363494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=576e452d50d14d4ea03aac77c855d430, user_id=1d98e16d93d147f5927b6dab00efda94, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.366431 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.376675 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1122/2256] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:29 2021] PUT /identity/v3/projects/576e452d50d14d4ea03aac77c855d430/users/1d98e16d93d147f5927b6dab00efda94/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:29.386379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6ef7-d530-4e87-abf6-dd19cc801811 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.386673 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6ef7-d530-4e87-abf6-dd19cc801811 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.386956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6ef7-d530-4e87-abf6-dd19cc801811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.412300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-903e6ef7-d530-4e87-abf6-dd19cc801811 None None] MFA Rules not processed for user `1d98e16d93d147f5927b6dab00efda94`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:29.413468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-903e6ef7-d530-4e87-abf6-dd19cc801811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:29.479007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1135/2257] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:29 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:40:29.490066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.491726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:29.546998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea3ef1-1115-47cb-8e0c-c1df4f516d4e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.550518 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443152e-3164-4a34-ad53-1bd787a63e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.551149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443152e-3164-4a34-ad53-1bd787a63e45 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.551430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443152e-3164-4a34-ad53-1bd787a63e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.551729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443152e-3164-4a34-ad53-1bd787a63e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.560797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443152e-3164-4a34-ad53-1bd787a63e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.562223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443152e-3164-4a34-ad53-1bd787a63e45 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.570804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1123/2258] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:29 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:29.852946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6ef7-d530-4e87-abf6-dd19cc801811 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.862591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6ef7-d530-4e87-abf6-dd19cc801811 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.867041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d98e16d93d147f5927b6dab00efda94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576e452d50d14d4ea03aac77c855d430', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.867696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.868034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.868291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.869014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:40:29.869321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.871615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.883142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1136/2259] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:40:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:40:29.887466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443152e-3164-4a34-ad53-1bd787a63e45 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.896306 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443152e-3164-4a34-ad53-1bd787a63e45 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:29.900720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fcdfd-0ba3-4611-9537-6ceb50433045 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d98e16d93d147f5927b6dab00efda94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576e452d50d14d4ea03aac77c855d430', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:29.901379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fcdfd-0ba3-4611-9537-6ceb50433045 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:29.901672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fcdfd-0ba3-4611-9537-6ceb50433045 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:29.901941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fcdfd-0ba3-4611-9537-6ceb50433045 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:29.903173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fcdfd-0ba3-4611-9537-6ceb50433045 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:29.905123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fcdfd-0ba3-4611-9537-6ceb50433045 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:29.932058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1124/2260] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:29 2021] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:40:29.936306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:29.946128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fce90b-fead-4cb8-897e-5fb9044d9f6e tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:30.000207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d98e16d93d147f5927b6dab00efda94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576e452d50d14d4ea03aac77c855d430', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:30.000878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:30.001163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:30.001445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:30.002151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:40:30.002454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:30.004088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:30.023503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1137/2261] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:40:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:40:30.057918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fcdfd-0ba3-4611-9537-6ceb50433045 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:30.067819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fcdfd-0ba3-4611-9537-6ceb50433045 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:30.073671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d98e16d93d147f5927b6dab00efda94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576e452d50d14d4ea03aac77c855d430', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:30.074059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:30.074473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:30.074735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] PATH_INFO: `/v3/projects/cdc0341fe284411e9db1c8507c7ff77c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:30.075928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cdc0341fe284411e9db1c8507c7ff77c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:30.077838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:30.123929 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc0341fe284411e9db1c8507c7ff77c', 'request_id': 'req-442f2c38-7553-4f0c-a0d6-c650e3247737'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.130532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc0341fe284411e9db1c8507c7ff77c', 'request_id': 'req-442f2c38-7553-4f0c-a0d6-c650e3247737'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.138655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc0341fe284411e9db1c8507c7ff77c', 'request_id': 'req-442f2c38-7553-4f0c-a0d6-c650e3247737'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.149022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] The token cache is being invalidate because project cdc0341fe284411e9db1c8507c7ff77c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:30.149304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.149974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-442f2c38-7553-4f0c-a0d6-c650e3247737 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.151520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1125/2262] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:30 2021] DELETE /identity/v3/projects/cdc0341fe284411e9db1c8507c7ff77c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:30.321575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:30.323138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:30.384639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590dc93-d5c4-4139-a966-b02496a8bf91 tempest-VolumeQuotaClassesTest-116763681 tempest-VolumeQuotaClassesTest-116763681-project-admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:30.438030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:30.438900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:30.439165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:30.439452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] PATH_INFO: `/v3/users/0fa10b272d264c8a93aeb5edb3191e30` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:30.440611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa10b272d264c8a93aeb5edb3191e30)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:30.442521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:30.486706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa10b272d264c8a93aeb5edb3191e30'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.497931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa10b272d264c8a93aeb5edb3191e30'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.504352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa10b272d264c8a93aeb5edb3191e30'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.504991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa10b272d264c8a93aeb5edb3191e30'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.512580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa10b272d264c8a93aeb5edb3191e30'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:30.518194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1138/2263] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:30 2021] DELETE /identity/v3/users/0fa10b272d264c8a93aeb5edb3191e30 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:30.522649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03957a-d373-4910-9d62-cf2588572a86 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:30.522965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03957a-d373-4910-9d62-cf2588572a86 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:30.523246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03957a-d373-4910-9d62-cf2588572a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:30.540206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3e03957a-d373-4910-9d62-cf2588572a86 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:30.541398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3e03957a-d373-4910-9d62-cf2588572a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:30.596963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1126/2264] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:30.606918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:30.608323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:30.662382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482c549-aa6f-425a-80c5-31c167610f5e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:30.665828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3498-d2d5-44aa-88c0-3b5260c4afb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:30.666452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3498-d2d5-44aa-88c0-3b5260c4afb7 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:30.666729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3498-d2d5-44aa-88c0-3b5260c4afb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:30.666998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3498-d2d5-44aa-88c0-3b5260c4afb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:30.675616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e3498-d2d5-44aa-88c0-3b5260c4afb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:30.677057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e3498-d2d5-44aa-88c0-3b5260c4afb7 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:30.689043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1139/2265] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:30.962653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03957a-d373-4910-9d62-cf2588572a86 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:30.964117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3e03957a-d373-4910-9d62-cf2588572a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:30.976056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03957a-d373-4910-9d62-cf2588572a86 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:30.980386 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:30.981752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:30.982029 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:30.982297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] PATH_INFO: `/v3/projects/d41cabf4afe14f35abc143dda1255700` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:30.983438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41cabf4afe14f35abc143dda1255700)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:30.985409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:31.029838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41cabf4afe14f35abc143dda1255700', 'request_id': 'req-b3b78624-74e8-4486-8636-e29a3c5d1f2f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.035920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41cabf4afe14f35abc143dda1255700', 'request_id': 'req-b3b78624-74e8-4486-8636-e29a3c5d1f2f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.046044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41cabf4afe14f35abc143dda1255700', 'request_id': 'req-b3b78624-74e8-4486-8636-e29a3c5d1f2f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.057011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] The token cache is being invalidate because project d41cabf4afe14f35abc143dda1255700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:31.057297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.058023 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.060472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1127/2266] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:30 2021] DELETE /identity/v3/projects/d41cabf4afe14f35abc143dda1255700 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:31.064481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3498-d2d5-44aa-88c0-3b5260c4afb7 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:31.073756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3498-d2d5-44aa-88c0-3b5260c4afb7 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:31.130946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:31.131917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.132270 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.132615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] PATH_INFO: `/v3/users/1d98e16d93d147f5927b6dab00efda94` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.133829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d98e16d93d147f5927b6dab00efda94)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:31.135875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:31.185696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d98e16d93d147f5927b6dab00efda94'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.196926 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d98e16d93d147f5927b6dab00efda94'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.203500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d98e16d93d147f5927b6dab00efda94'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.204177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d98e16d93d147f5927b6dab00efda94'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.211540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-256cf574-631d-4304-b5af-035897f6ed43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d98e16d93d147f5927b6dab00efda94'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.217306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1140/2267] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:31 2021] DELETE /identity/v3/users/1d98e16d93d147f5927b6dab00efda94 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:31.491800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:31.493325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:31.506477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78624-74e8-4486-8636-e29a3c5d1f2f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:31.560968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:31.561817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.562100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.562372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] PATH_INFO: `/v3/projects/576e452d50d14d4ea03aac77c855d430` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.563508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576e452d50d14d4ea03aac77c855d430)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:31.565449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:31.610432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576e452d50d14d4ea03aac77c855d430', 'request_id': 'req-563f1ba7-88ae-4741-86f8-eb583701ffe5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.616404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576e452d50d14d4ea03aac77c855d430', 'request_id': 'req-563f1ba7-88ae-4741-86f8-eb583701ffe5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.623160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576e452d50d14d4ea03aac77c855d430', 'request_id': 'req-563f1ba7-88ae-4741-86f8-eb583701ffe5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.633790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] The token cache is being invalidate because project 576e452d50d14d4ea03aac77c855d430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:31.634094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.634713 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-563f1ba7-88ae-4741-86f8-eb583701ffe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:31.636287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1128/2268] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:31 2021] DELETE /identity/v3/projects/576e452d50d14d4ea03aac77c855d430 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:40:31.642100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedd07-38ad-4ae8-a458-35261fb62c75 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.642485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedd07-38ad-4ae8-a458-35261fb62c75 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.642827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedd07-38ad-4ae8-a458-35261fb62c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.660014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-89aedd07-38ad-4ae8-a458-35261fb62c75 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:31.661156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-89aedd07-38ad-4ae8-a458-35261fb62c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:31.715198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1141/2269] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:40:31.733904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d2d9-a915-4a5b-bed6-d80adec919b4 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.734188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d2d9-a915-4a5b-bed6-d80adec919b4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.734469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d2d9-a915-4a5b-bed6-d80adec919b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.752513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-4391d2d9-a915-4a5b-bed6-d80adec919b4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:31.753671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4391d2d9-a915-4a5b-bed6-d80adec919b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:31.760909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1129/2270] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:40:31.765668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aedd07-38ad-4ae8-a458-35261fb62c75 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:31.774676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aedd07-38ad-4ae8-a458-35261fb62c75 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:31.779578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:31.780273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.780560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.780834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.781579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:40:31.781887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:31.783474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:31.794820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1142/2271] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:40:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:40:31.798935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391d2d9-a915-4a5b-bed6-d80adec919b4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:31.807741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391d2d9-a915-4a5b-bed6-d80adec919b4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:31.812842 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c591b-f283-4039-88f1-8d2ceb9f7931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:31.813479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c591b-f283-4039-88f1-8d2ceb9f7931 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.813757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c591b-f283-4039-88f1-8d2ceb9f7931 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.814030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c591b-f283-4039-88f1-8d2ceb9f7931 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.814716 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c591b-f283-4039-88f1-8d2ceb9f7931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:31.816643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c591b-f283-4039-88f1-8d2ceb9f7931 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:31.842113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1130/2272] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:31 2021] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:40:31.846881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:31.856234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfb35e-b199-4a5a-b65e-c139b2d2022d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:31.910680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ec88f-2b7a-44a1-b6e2-5e380801f15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:31.911271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ec88f-2b7a-44a1-b6e2-5e380801f15d admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.911548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ec88f-2b7a-44a1-b6e2-5e380801f15d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.911864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ec88f-2b7a-44a1-b6e2-5e380801f15d admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.912609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ec88f-2b7a-44a1-b6e2-5e380801f15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:31.914487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ec88f-2b7a-44a1-b6e2-5e380801f15d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:31.933131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1143/2273] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:31 2021] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:31.937468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c591b-f283-4039-88f1-8d2ceb9f7931 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:31.947437 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c591b-f283-4039-88f1-8d2ceb9f7931 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:31.952649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ae8a-f09f-43a8-9751-893bcf45087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:31.953306 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ae8a-f09f-43a8-9751-893bcf45087c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.953590 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ae8a-f09f-43a8-9751-893bcf45087c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.953868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ae8a-f09f-43a8-9751-893bcf45087c admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.954591 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27ae8a-f09f-43a8-9751-893bcf45087c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:31.956228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27ae8a-f09f-43a8-9751-893bcf45087c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:31.967218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1131/2274] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:31.971349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ec88f-2b7a-44a1-b6e2-5e380801f15d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:31.980388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ec88f-2b7a-44a1-b6e2-5e380801f15d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:31.985187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eb6a8-d2ce-4cc6-8c8e-f52b0dd4695c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:31.985832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb6a8-d2ce-4cc6-8c8e-f52b0dd4695c admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:31.986114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb6a8-d2ce-4cc6-8c8e-f52b0dd4695c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:31.986389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb6a8-d2ce-4cc6-8c8e-f52b0dd4695c admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:31.987132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb6a8-d2ce-4cc6-8c8e-f52b0dd4695c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:31.988753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb6a8-d2ce-4cc6-8c8e-f52b0dd4695c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:31.998530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1144/2275] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:31 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:40:32.002478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ae8a-f09f-43a8-9751-893bcf45087c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.011983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ae8a-f09f-43a8-9751-893bcf45087c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.017186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dda8e-7855-4522-8801-0260fddff18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.018066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dda8e-7855-4522-8801-0260fddff18b admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.018348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dda8e-7855-4522-8801-0260fddff18b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.018622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dda8e-7855-4522-8801-0260fddff18b admin admin] PATH_INFO: `/v3/projects/87c3ecc190074631a5a557dfaaca8928/users/4fb2c88c2d604a609ebbcb89411e9b37/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.033429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dda8e-7855-4522-8801-0260fddff18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c3ecc190074631a5a557dfaaca8928, user_id=4fb2c88c2d604a609ebbcb89411e9b37, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.036125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dda8e-7855-4522-8801-0260fddff18b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.049527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1132/2276] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:32 2021] PUT /identity/v3/projects/87c3ecc190074631a5a557dfaaca8928/users/4fb2c88c2d604a609ebbcb89411e9b37/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:32.060521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd619cf-0f68-44b3-b4d6-3904bf5f5240 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.060841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd619cf-0f68-44b3-b4d6-3904bf5f5240 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.061122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd619cf-0f68-44b3-b4d6-3904bf5f5240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.086158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0bd619cf-0f68-44b3-b4d6-3904bf5f5240 None None] MFA Rules not processed for user `4fb2c88c2d604a609ebbcb89411e9b37`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:32.087347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0bd619cf-0f68-44b3-b4d6-3904bf5f5240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:32.152729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1145/2277] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:32 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:40:32.157563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dda8e-7855-4522-8801-0260fddff18b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.217563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dda8e-7855-4522-8801-0260fddff18b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.222546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a105-49d2-42cb-90b4-9fcb71949670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.223203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a105-49d2-42cb-90b4-9fcb71949670 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.223490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a105-49d2-42cb-90b4-9fcb71949670 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.223794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a105-49d2-42cb-90b4-9fcb71949670 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.224493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2a105-49d2-42cb-90b4-9fcb71949670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.226388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2a105-49d2-42cb-90b4-9fcb71949670 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.252812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1133/2278] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:32 2021] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:40:32.256614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd619cf-0f68-44b3-b4d6-3904bf5f5240 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.266602 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd619cf-0f68-44b3-b4d6-3904bf5f5240 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.323132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b9e83-1c71-4cb5-b015-ec8d50451ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.323845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b9e83-1c71-4cb5-b015-ec8d50451ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.324128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b9e83-1c71-4cb5-b015-ec8d50451ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.324405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b9e83-1c71-4cb5-b015-ec8d50451ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.325300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b9e83-1c71-4cb5-b015-ec8d50451ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.327205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b9e83-1c71-4cb5-b015-ec8d50451ee9 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.347578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1146/2279] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:32 2021] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:32.351546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a105-49d2-42cb-90b4-9fcb71949670 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.362084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a105-49d2-42cb-90b4-9fcb71949670 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.366439 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11330f15-cd0a-4d5a-80a8-29d7db34a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.367404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11330f15-cd0a-4d5a-80a8-29d7db34a173 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.367684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11330f15-cd0a-4d5a-80a8-29d7db34a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.367983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11330f15-cd0a-4d5a-80a8-29d7db34a173 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.368714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11330f15-cd0a-4d5a-80a8-29d7db34a173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.370399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11330f15-cd0a-4d5a-80a8-29d7db34a173 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.381454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1134/2280] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:32.385678 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b9e83-1c71-4cb5-b015-ec8d50451ee9 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.394914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b9e83-1c71-4cb5-b015-ec8d50451ee9 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.399339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25676-e419-40b0-b858-a54761795096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.400252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25676-e419-40b0-b858-a54761795096 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.400533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25676-e419-40b0-b858-a54761795096 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.400804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25676-e419-40b0-b858-a54761795096 admin admin] PATH_INFO: `/v3/projects/d70f203b5c994d6e85eaec0b515a6bb6/users/3672ddcd70f9406d9682fd5752505cb2/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.415558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b25676-e419-40b0-b858-a54761795096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70f203b5c994d6e85eaec0b515a6bb6, user_id=3672ddcd70f9406d9682fd5752505cb2, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.418244 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b25676-e419-40b0-b858-a54761795096 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.432392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1147/2281] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:32 2021] PUT /identity/v3/projects/d70f203b5c994d6e85eaec0b515a6bb6/users/3672ddcd70f9406d9682fd5752505cb2/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:32.436545 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11330f15-cd0a-4d5a-80a8-29d7db34a173 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.445846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11330f15-cd0a-4d5a-80a8-29d7db34a173 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.502932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76ada-f37b-4a64-8ec8-170a767eaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.503896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76ada-f37b-4a64-8ec8-170a767eaa8f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.503896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76ada-f37b-4a64-8ec8-170a767eaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.504166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76ada-f37b-4a64-8ec8-170a767eaa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.504909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76ada-f37b-4a64-8ec8-170a767eaa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.506509 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76ada-f37b-4a64-8ec8-170a767eaa8f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.516994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1135/2282] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:32 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:40:32.520838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25676-e419-40b0-b858-a54761795096 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.531286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25676-e419-40b0-b858-a54761795096 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.535852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.536736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.537015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.537326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] PATH_INFO: `/v3/projects/d70f203b5c994d6e85eaec0b515a6bb6/users/3672ddcd70f9406d9682fd5752505cb2/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.539248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70f203b5c994d6e85eaec0b515a6bb6, user_id=3672ddcd70f9406d9682fd5752505cb2, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.541938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.553072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1148/2283] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:32 2021] PUT /identity/v3/projects/d70f203b5c994d6e85eaec0b515a6bb6/users/3672ddcd70f9406d9682fd5752505cb2/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:32.564910 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a707-5efe-4ae6-a1c4-98765fbc378d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.565201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a707-5efe-4ae6-a1c4-98765fbc378d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.565476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a707-5efe-4ae6-a1c4-98765fbc378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.590941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ef16a707-5efe-4ae6-a1c4-98765fbc378d None None] MFA Rules not processed for user `3672ddcd70f9406d9682fd5752505cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:32.592153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ef16a707-5efe-4ae6-a1c4-98765fbc378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:32.655850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1136/2284] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:32 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:40:32.665610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.667288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:32.742816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36c56f-4a20-4f93-adf8-84d45f6ac3e8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.746223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49674194-3e8a-4567-bf2a-07f1d86e285e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.747602 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674194-3e8a-4567-bf2a-07f1d86e285e service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.747899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674194-3e8a-4567-bf2a-07f1d86e285e service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.748165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674194-3e8a-4567-bf2a-07f1d86e285e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.756476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49674194-3e8a-4567-bf2a-07f1d86e285e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.757893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49674194-3e8a-4567-bf2a-07f1d86e285e service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.766439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1149/2285] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:32 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:32.808091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a707-5efe-4ae6-a1c4-98765fbc378d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:32.810212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ef16a707-5efe-4ae6-a1c4-98765fbc378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:32.821324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a707-5efe-4ae6-a1c4-98765fbc378d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:32.825295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1593c3f-f952-4ba1-8445-3f751749fd32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:32.825953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593c3f-f952-4ba1-8445-3f751749fd32 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:32.826232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593c3f-f952-4ba1-8445-3f751749fd32 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:32.826500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593c3f-f952-4ba1-8445-3f751749fd32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:32.880756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593c3f-f952-4ba1-8445-3f751749fd32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:32.882193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593c3f-f952-4ba1-8445-3f751749fd32 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:32.890492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1137/2286] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:32 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:36.104695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49674194-3e8a-4567-bf2a-07f1d86e285e service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:36.165743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49674194-3e8a-4567-bf2a-07f1d86e285e service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:36.170529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:36.171401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:36.171680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:36.171989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] PATH_INFO: `/v3/users/4fb2c88c2d604a609ebbcb89411e9b37` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:36.173193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb2c88c2d604a609ebbcb89411e9b37)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:36.175136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:36.220001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb2c88c2d604a609ebbcb89411e9b37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.231855 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb2c88c2d604a609ebbcb89411e9b37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.238361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb2c88c2d604a609ebbcb89411e9b37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.239012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb2c88c2d604a609ebbcb89411e9b37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.245747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb2c88c2d604a609ebbcb89411e9b37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.252547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1150/2287] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:36 2021] DELETE /identity/v3/users/4fb2c88c2d604a609ebbcb89411e9b37 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:36.257163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a82d5-d0ec-4d1b-a0a4-b585ff21a94b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:36.257657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a82d5-d0ec-4d1b-a0a4-b585ff21a94b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:36.257752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a82d5-d0ec-4d1b-a0a4-b585ff21a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:36.273969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3b2a82d5-d0ec-4d1b-a0a4-b585ff21a94b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:36.275123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3b2a82d5-d0ec-4d1b-a0a4-b585ff21a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:36.330132 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1138/2288] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:36.339996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:36.341642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:36.395167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58e49-8fc2-4588-aa6b-653a1320e41f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:36.398654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74db214-8ac4-41a9-b6a8-e95e6edc2530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:36.399288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74db214-8ac4-41a9-b6a8-e95e6edc2530 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:36.399569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74db214-8ac4-41a9-b6a8-e95e6edc2530 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:36.399876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74db214-8ac4-41a9-b6a8-e95e6edc2530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:36.408294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74db214-8ac4-41a9-b6a8-e95e6edc2530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:36.409714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74db214-8ac4-41a9-b6a8-e95e6edc2530 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:36.418232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1151/2289] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:36.688172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a82d5-d0ec-4d1b-a0a4-b585ff21a94b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:36.689634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3b2a82d5-d0ec-4d1b-a0a4-b585ff21a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:36.707787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a82d5-d0ec-4d1b-a0a4-b585ff21a94b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:36.712442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:36.713303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:36.713622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:36.713849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] PATH_INFO: `/v3/projects/87c3ecc190074631a5a557dfaaca8928` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:36.715031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c3ecc190074631a5a557dfaaca8928)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:36.717614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:36.764134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c3ecc190074631a5a557dfaaca8928', 'request_id': 'req-4f7ea263-ebe6-4c83-99ca-2cf719551d20'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.770230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c3ecc190074631a5a557dfaaca8928', 'request_id': 'req-4f7ea263-ebe6-4c83-99ca-2cf719551d20'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.776810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c3ecc190074631a5a557dfaaca8928', 'request_id': 'req-4f7ea263-ebe6-4c83-99ca-2cf719551d20'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.787034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] The token cache is being invalidate because project 87c3ecc190074631a5a557dfaaca8928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:36.787317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.787949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.789485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1139/2290] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:36 2021] DELETE /identity/v3/projects/87c3ecc190074631a5a557dfaaca8928 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:36.793521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74db214-8ac4-41a9-b6a8-e95e6edc2530 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:36.803169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74db214-8ac4-41a9-b6a8-e95e6edc2530 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:36.856233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:36.857741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:36.858024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:36.858287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] PATH_INFO: `/v3/users/3672ddcd70f9406d9682fd5752505cb2` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:36.859445 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3672ddcd70f9406d9682fd5752505cb2)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:36.861377 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:36.903447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3672ddcd70f9406d9682fd5752505cb2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.915018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3672ddcd70f9406d9682fd5752505cb2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.922089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3672ddcd70f9406d9682fd5752505cb2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.922723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3672ddcd70f9406d9682fd5752505cb2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.929327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ae7f34e-fe75-43b9-a6b1-276c9f5fb177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3672ddcd70f9406d9682fd5752505cb2'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:36.935120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1152/2291] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:36 2021] DELETE /identity/v3/users/3672ddcd70f9406d9682fd5752505cb2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:40:37.207747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:37.209124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:37.221940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea263-ebe6-4c83-99ca-2cf719551d20 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:37.278297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:37.279415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.280044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.280334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] PATH_INFO: `/v3/projects/d70f203b5c994d6e85eaec0b515a6bb6` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.281553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70f203b5c994d6e85eaec0b515a6bb6)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:37.283646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:37.332480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70f203b5c994d6e85eaec0b515a6bb6', 'request_id': 'req-99724666-fd53-4e7a-8c72-d000a67d35c8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:37.339210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70f203b5c994d6e85eaec0b515a6bb6', 'request_id': 'req-99724666-fd53-4e7a-8c72-d000a67d35c8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:37.347594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70f203b5c994d6e85eaec0b515a6bb6', 'request_id': 'req-99724666-fd53-4e7a-8c72-d000a67d35c8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:37.358995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] The token cache is being invalidate because project d70f203b5c994d6e85eaec0b515a6bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:37.359283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:37.359984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-99724666-fd53-4e7a-8c72-d000a67d35c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:37.361770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1140/2292] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:37 2021] DELETE /identity/v3/projects/d70f203b5c994d6e85eaec0b515a6bb6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:37.367692 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0bb0b-708b-4dfd-b569-12b784184835 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.368243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0bb0b-708b-4dfd-b569-12b784184835 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.368366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0bb0b-708b-4dfd-b569-12b784184835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.386605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-29e0bb0b-708b-4dfd-b569-12b784184835 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:37.387833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-29e0bb0b-708b-4dfd-b569-12b784184835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:37.449812 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1153/2293] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:37.458667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001a56-16de-49e0-872c-9b0a0326017f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.459110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001a56-16de-49e0-872c-9b0a0326017f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.459403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001a56-16de-49e0-872c-9b0a0326017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.479054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-2c001a56-16de-49e0-872c-9b0a0326017f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:37.480281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2c001a56-16de-49e0-872c-9b0a0326017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:37.488455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1141/2294] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:37.492954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0bb0b-708b-4dfd-b569-12b784184835 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:37.502546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0bb0b-708b-4dfd-b569-12b784184835 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:37.507058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:37.507765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.508054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.508332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.509076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:40:37.509382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:37.511022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:37.522709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1154/2295] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:40:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:40:37.527123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c001a56-16de-49e0-872c-9b0a0326017f None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:37.536629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c001a56-16de-49e0-872c-9b0a0326017f None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:37.541094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb53fd-977b-4336-9993-5999a44cb2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:37.541748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb53fd-977b-4336-9993-5999a44cb2cc admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.542034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb53fd-977b-4336-9993-5999a44cb2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.542313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb53fd-977b-4336-9993-5999a44cb2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.543014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb53fd-977b-4336-9993-5999a44cb2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:37.545527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb53fd-977b-4336-9993-5999a44cb2cc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:37.575180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1142/2296] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:37 2021] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:40:37.576337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:37.585932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750d00e-ce58-41ed-b35c-c6f429b3e604 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:37.641227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363836ac-998b-435b-9caf-e50ae8fe556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:37.641901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363836ac-998b-435b-9caf-e50ae8fe556b admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.642187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363836ac-998b-435b-9caf-e50ae8fe556b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.642468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363836ac-998b-435b-9caf-e50ae8fe556b admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.643145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363836ac-998b-435b-9caf-e50ae8fe556b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:37.645096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363836ac-998b-435b-9caf-e50ae8fe556b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:37.664446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1155/2297] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:37 2021] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:40:37.668535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb53fd-977b-4336-9993-5999a44cb2cc admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:37.678988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb53fd-977b-4336-9993-5999a44cb2cc admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:37.683315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230879a7-cdbd-4d20-9044-b6fca1139a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:37.683995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230879a7-cdbd-4d20-9044-b6fca1139a9c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.684274 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230879a7-cdbd-4d20-9044-b6fca1139a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.684546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230879a7-cdbd-4d20-9044-b6fca1139a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.685453 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230879a7-cdbd-4d20-9044-b6fca1139a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:37.687172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230879a7-cdbd-4d20-9044-b6fca1139a9c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:37.697215 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1143/2298] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:37 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:37.702005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363836ac-998b-435b-9caf-e50ae8fe556b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:37.711398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363836ac-998b-435b-9caf-e50ae8fe556b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:37.715685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d997f-2f71-413b-b680-805816b6c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:37.717901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d997f-2f71-413b-b680-805816b6c321 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.718195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d997f-2f71-413b-b680-805816b6c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.718470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d997f-2f71-413b-b680-805816b6c321 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.719184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d997f-2f71-413b-b680-805816b6c321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:37.721105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d997f-2f71-413b-b680-805816b6c321 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:37.730583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1156/2299] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:37.735790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230879a7-cdbd-4d20-9044-b6fca1139a9c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:37.745066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230879a7-cdbd-4d20-9044-b6fca1139a9c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:37.750153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4942ea-e384-41ae-885c-6dabf6add897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:37.751046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4942ea-e384-41ae-885c-6dabf6add897 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.751460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4942ea-e384-41ae-885c-6dabf6add897 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.751635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4942ea-e384-41ae-885c-6dabf6add897 admin admin] PATH_INFO: `/v3/projects/597b6a49dbaf4925a1255d6ef4d0d773/users/4b3e4ebe52f749e19d1e2ee3295e029b/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.767108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4942ea-e384-41ae-885c-6dabf6add897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597b6a49dbaf4925a1255d6ef4d0d773, user_id=4b3e4ebe52f749e19d1e2ee3295e029b, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:37.769782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4942ea-e384-41ae-885c-6dabf6add897 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:37.785757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1144/2300] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:37 2021] PUT /identity/v3/projects/597b6a49dbaf4925a1255d6ef4d0d773/users/4b3e4ebe52f749e19d1e2ee3295e029b/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:40:37.796253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfd28-d796-41bd-829f-bd0f20dda4fb None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.796546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfd28-d796-41bd-829f-bd0f20dda4fb None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.796823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfd28-d796-41bd-829f-bd0f20dda4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.822732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d3cbfd28-d796-41bd-829f-bd0f20dda4fb None None] MFA Rules not processed for user `4b3e4ebe52f749e19d1e2ee3295e029b`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:37.823953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d3cbfd28-d796-41bd-829f-bd0f20dda4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:37.891599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1157/2301] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:37 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:37.896129 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4942ea-e384-41ae-885c-6dabf6add897 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:37.955968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4942ea-e384-41ae-885c-6dabf6add897 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:37.960530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b9a3-789a-4f18-b840-28022ce56f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:37.961180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b9a3-789a-4f18-b840-28022ce56f31 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:37.961462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b9a3-789a-4f18-b840-28022ce56f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:37.961736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b9a3-789a-4f18-b840-28022ce56f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:37.962427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95b9a3-789a-4f18-b840-28022ce56f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:37.964412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95b9a3-789a-4f18-b840-28022ce56f31 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:37.989073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1145/2302] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:37 2021] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:37.993131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbfd28-d796-41bd-829f-bd0f20dda4fb None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:38.003136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbfd28-d796-41bd-829f-bd0f20dda4fb None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:38.056105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f2f1d-0470-4669-b707-a439e40d77b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:38.056759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f2f1d-0470-4669-b707-a439e40d77b5 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:38.057038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f2f1d-0470-4669-b707-a439e40d77b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:38.057311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f2f1d-0470-4669-b707-a439e40d77b5 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:38.057994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f2f1d-0470-4669-b707-a439e40d77b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:38.059930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f2f1d-0470-4669-b707-a439e40d77b5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:38.079137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1158/2303] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:37 2021] POST /identity/v3/users => generated 300 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:40:38.083125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b9a3-789a-4f18-b840-28022ce56f31 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:38.092937 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b9a3-789a-4f18-b840-28022ce56f31 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:38.097631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2344a1-893f-42d9-a4b0-95eb864f7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:38.098285 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2344a1-893f-42d9-a4b0-95eb864f7a68 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:38.098575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2344a1-893f-42d9-a4b0-95eb864f7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:38.098851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2344a1-893f-42d9-a4b0-95eb864f7a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:38.099571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2344a1-893f-42d9-a4b0-95eb864f7a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:38.101189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2344a1-893f-42d9-a4b0-95eb864f7a68 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:38.112776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1146/2304] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:40:38.116766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f2f1d-0470-4669-b707-a439e40d77b5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:38.127664 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f2f1d-0470-4669-b707-a439e40d77b5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:38.132104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672730e7-2801-4067-8b16-6cb0fa57e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:38.132979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672730e7-2801-4067-8b16-6cb0fa57e0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:38.133261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672730e7-2801-4067-8b16-6cb0fa57e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:38.133540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672730e7-2801-4067-8b16-6cb0fa57e0bd admin admin] PATH_INFO: `/v3/projects/d2c2ea345950465a9db0010303e2acbf/users/be75b67e866f4150886dd6396ad9458a/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:38.148123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672730e7-2801-4067-8b16-6cb0fa57e0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2ea345950465a9db0010303e2acbf, user_id=be75b67e866f4150886dd6396ad9458a, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:38.150970 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672730e7-2801-4067-8b16-6cb0fa57e0bd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:38.163143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1159/2305] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:38 2021] PUT /identity/v3/projects/d2c2ea345950465a9db0010303e2acbf/users/be75b67e866f4150886dd6396ad9458a/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:40:38.167138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2344a1-893f-42d9-a4b0-95eb864f7a68 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:38.176392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2344a1-893f-42d9-a4b0-95eb864f7a68 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:38.229775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42dcb4-9e25-4530-9831-55527c6ed417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:38.230433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42dcb4-9e25-4530-9831-55527c6ed417 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:38.230710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42dcb4-9e25-4530-9831-55527c6ed417 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:38.230977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42dcb4-9e25-4530-9831-55527c6ed417 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:38.231690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42dcb4-9e25-4530-9831-55527c6ed417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:38.233667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42dcb4-9e25-4530-9831-55527c6ed417 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:38.242996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1147/2306] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:38 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:38.252937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672730e7-2801-4067-8b16-6cb0fa57e0bd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:38.262412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672730e7-2801-4067-8b16-6cb0fa57e0bd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:38.267473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:38.268381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:38.268661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:38.268931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] PATH_INFO: `/v3/projects/d2c2ea345950465a9db0010303e2acbf/users/be75b67e866f4150886dd6396ad9458a/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:38.270907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2ea345950465a9db0010303e2acbf, user_id=be75b67e866f4150886dd6396ad9458a, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:38.273593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:38.284010 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1160/2307] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:38 2021] PUT /identity/v3/projects/d2c2ea345950465a9db0010303e2acbf/users/be75b67e866f4150886dd6396ad9458a/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:38.295149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb08f-a272-40db-bdbe-06c3b6e6f123 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:38.295622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb08f-a272-40db-bdbe-06c3b6e6f123 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:38.295766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb08f-a272-40db-bdbe-06c3b6e6f123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:38.321760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-cebdb08f-a272-40db-bdbe-06c3b6e6f123 None None] MFA Rules not processed for user `be75b67e866f4150886dd6396ad9458a`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:38.322925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-cebdb08f-a272-40db-bdbe-06c3b6e6f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:38.387692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1148/2308] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:38 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:38.397983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:38.399727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:38.455613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda7fe-522f-48fb-b714-d937b498083a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:38.459194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031aa73-f305-4d08-87b9-5581af3871ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:38.459869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031aa73-f305-4d08-87b9-5581af3871ba service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:38.460151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031aa73-f305-4d08-87b9-5581af3871ba service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:38.460426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031aa73-f305-4d08-87b9-5581af3871ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:38.469394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031aa73-f305-4d08-87b9-5581af3871ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:38.471082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031aa73-f305-4d08-87b9-5581af3871ba service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:38.480525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1161/2309] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:38 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:39.091420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdb08f-a272-40db-bdbe-06c3b6e6f123 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:39.153734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdb08f-a272-40db-bdbe-06c3b6e6f123 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:39.158406 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:39.159216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:39.159500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:39.159809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] PATH_INFO: `/v3/users/4b3e4ebe52f749e19d1e2ee3295e029b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:39.160994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3e4ebe52f749e19d1e2ee3295e029b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:39.162964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:39.209284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3e4ebe52f749e19d1e2ee3295e029b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.221001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3e4ebe52f749e19d1e2ee3295e029b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.221667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3e4ebe52f749e19d1e2ee3295e029b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.228692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3e4ebe52f749e19d1e2ee3295e029b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.229298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3e4ebe52f749e19d1e2ee3295e029b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.241612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1149/2310] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:39 2021] DELETE /identity/v3/users/4b3e4ebe52f749e19d1e2ee3295e029b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:39.246119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5888-69a8-4243-ae07-da90a5dd5452 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:39.246414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5888-69a8-4243-ae07-da90a5dd5452 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:39.246698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5888-69a8-4243-ae07-da90a5dd5452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:39.264506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0e1a5888-69a8-4243-ae07-da90a5dd5452 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:39.265668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0e1a5888-69a8-4243-ae07-da90a5dd5452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:39.321034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1162/2311] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:39.330893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:39.332258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:39.385840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da05a-79ae-4d4a-bf31-cc953d135177 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:39.389403 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a9611-c955-4715-9bd9-0271c62bbae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:39.390064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9611-c955-4715-9bd9-0271c62bbae6 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:39.390340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9611-c955-4715-9bd9-0271c62bbae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:39.390613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9611-c955-4715-9bd9-0271c62bbae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:39.399072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a9611-c955-4715-9bd9-0271c62bbae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:39.400570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a9611-c955-4715-9bd9-0271c62bbae6 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:39.409430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1150/2312] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:39.676208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5888-69a8-4243-ae07-da90a5dd5452 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:39.677601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0e1a5888-69a8-4243-ae07-da90a5dd5452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:39.689463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5888-69a8-4243-ae07-da90a5dd5452 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:39.694621 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:39.695567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:39.695934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:39.696267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] PATH_INFO: `/v3/projects/597b6a49dbaf4925a1255d6ef4d0d773` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:39.697504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=597b6a49dbaf4925a1255d6ef4d0d773)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:39.699676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:39.749093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597b6a49dbaf4925a1255d6ef4d0d773', 'request_id': 'req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.755008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597b6a49dbaf4925a1255d6ef4d0d773', 'request_id': 'req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.761725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597b6a49dbaf4925a1255d6ef4d0d773', 'request_id': 'req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.772003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] The token cache is being invalidate because project 597b6a49dbaf4925a1255d6ef4d0d773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:39.772305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.772917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.774448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1163/2313] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:39 2021] DELETE /identity/v3/projects/597b6a49dbaf4925a1255d6ef4d0d773 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:39.778410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a9611-c955-4715-9bd9-0271c62bbae6 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:39.787944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a9611-c955-4715-9bd9-0271c62bbae6 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:39.842852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:39.843733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:39.844026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:39.844303 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] PATH_INFO: `/v3/users/be75b67e866f4150886dd6396ad9458a` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:39.845701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be75b67e866f4150886dd6396ad9458a)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:39.847640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:39.893531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be75b67e866f4150886dd6396ad9458a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.905662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be75b67e866f4150886dd6396ad9458a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.906334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be75b67e866f4150886dd6396ad9458a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.914647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be75b67e866f4150886dd6396ad9458a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.915251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-6044a716-8b57-4f7e-ae65-5225494e6379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be75b67e866f4150886dd6396ad9458a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:39.928632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1151/2314] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:39 2021] DELETE /identity/v3/users/be75b67e866f4150886dd6396ad9458a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:40.292381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:40.294060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:40.308712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c28c3-3376-4a8f-85b5-3b1d209f3c5b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:40.366149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:40.367225 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.367602 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.368002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] PATH_INFO: `/v3/projects/d2c2ea345950465a9db0010303e2acbf` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.369249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c2ea345950465a9db0010303e2acbf)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:40.371292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:40.416317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c2ea345950465a9db0010303e2acbf', 'request_id': 'req-c5355428-91ac-4e35-9a39-45421e37e133'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:40.422693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c2ea345950465a9db0010303e2acbf', 'request_id': 'req-c5355428-91ac-4e35-9a39-45421e37e133'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:40.430177 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c2ea345950465a9db0010303e2acbf', 'request_id': 'req-c5355428-91ac-4e35-9a39-45421e37e133'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:40.441380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] The token cache is being invalidate because project d2c2ea345950465a9db0010303e2acbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:40.441777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:40.442415 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-c5355428-91ac-4e35-9a39-45421e37e133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:40.448137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1164/2315] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:40 2021] DELETE /identity/v3/projects/d2c2ea345950465a9db0010303e2acbf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:40:40.450349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50c1eb-f470-4b11-ab0e-a76644161d1c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.450843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50c1eb-f470-4b11-ab0e-a76644161d1c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.451587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50c1eb-f470-4b11-ab0e-a76644161d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.471488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ff50c1eb-f470-4b11-ab0e-a76644161d1c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:40.472708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ff50c1eb-f470-4b11-ab0e-a76644161d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:40.532647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1152/2316] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:40:40.540876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580439b9-2511-48da-a22f-d0449e89e4d3 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.541166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580439b9-2511-48da-a22f-d0449e89e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.541446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580439b9-2511-48da-a22f-d0449e89e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.559253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-580439b9-2511-48da-a22f-d0449e89e4d3 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:40.561407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-580439b9-2511-48da-a22f-d0449e89e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:40.568731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1165/2317] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:40.572955 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50c1eb-f470-4b11-ab0e-a76644161d1c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:40.583851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50c1eb-f470-4b11-ab0e-a76644161d1c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:40.588541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:40.589197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.589475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.589748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.590603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:40:40.591280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:40.593052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:40.605199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1153/2318] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:40:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:40:40.609945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580439b9-2511-48da-a22f-d0449e89e4d3 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:40.618727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580439b9-2511-48da-a22f-d0449e89e4d3 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:40.623737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b64c-bec2-411a-a7f8-474f05a8e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:40.624350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b64c-bec2-411a-a7f8-474f05a8e6ea admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.624634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b64c-bec2-411a-a7f8-474f05a8e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.624910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b64c-bec2-411a-a7f8-474f05a8e6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.625599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048b64c-bec2-411a-a7f8-474f05a8e6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:40.627482 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048b64c-bec2-411a-a7f8-474f05a8e6ea admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:40.653086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1166/2319] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:40 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:40.657379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:40.666541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b7ee-8435-427e-a9c7-88f3a100e99d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:40.726568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6e1d2-58d0-47a6-8e7b-bc633f9af62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:40.727161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e1d2-58d0-47a6-8e7b-bc633f9af62a admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.727438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e1d2-58d0-47a6-8e7b-bc633f9af62a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.727791 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e1d2-58d0-47a6-8e7b-bc633f9af62a admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.728436 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6e1d2-58d0-47a6-8e7b-bc633f9af62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:40.730387 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6e1d2-58d0-47a6-8e7b-bc633f9af62a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:40.757237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1154/2320] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:40 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:40.758747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b64c-bec2-411a-a7f8-474f05a8e6ea admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:40.776565 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b64c-bec2-411a-a7f8-474f05a8e6ea admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:40.782184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173853f-0a74-4c21-be21-4f9eca0d0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:40.783080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173853f-0a74-4c21-be21-4f9eca0d0337 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.783872 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173853f-0a74-4c21-be21-4f9eca0d0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.784151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173853f-0a74-4c21-be21-4f9eca0d0337 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.785218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173853f-0a74-4c21-be21-4f9eca0d0337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:40.787014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173853f-0a74-4c21-be21-4f9eca0d0337 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:40.804060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1167/2321] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:40 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:40.805461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6e1d2-58d0-47a6-8e7b-bc633f9af62a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:40.815644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6e1d2-58d0-47a6-8e7b-bc633f9af62a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:40.820262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15528be-5b3e-463c-ae76-e63c4fd4b126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:40.820957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15528be-5b3e-463c-ae76-e63c4fd4b126 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.821236 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15528be-5b3e-463c-ae76-e63c4fd4b126 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.821510 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15528be-5b3e-463c-ae76-e63c4fd4b126 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.822251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15528be-5b3e-463c-ae76-e63c4fd4b126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:40.823897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15528be-5b3e-463c-ae76-e63c4fd4b126 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:40.834893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1155/2322] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:40.839045 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173853f-0a74-4c21-be21-4f9eca0d0337 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:40.849459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173853f-0a74-4c21-be21-4f9eca0d0337 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:40.853873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:40.854730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.855004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.855274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] PATH_INFO: `/v3/projects/9d8183d1b3aa40bfac4be3ffc61a8e64/users/ad345e132ab8480bae8000b8f6a65ed8/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.869469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8183d1b3aa40bfac4be3ffc61a8e64, user_id=ad345e132ab8480bae8000b8f6a65ed8, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:40.872123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:40.884757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1168/2323] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:40 2021] PUT /identity/v3/projects/9d8183d1b3aa40bfac4be3ffc61a8e64/users/ad345e132ab8480bae8000b8f6a65ed8/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:40.895404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce54dc-93a8-4154-9922-f025f8c44d3d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:40.895727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce54dc-93a8-4154-9922-f025f8c44d3d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:40.896030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce54dc-93a8-4154-9922-f025f8c44d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:40.921741 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d1ce54dc-93a8-4154-9922-f025f8c44d3d None None] MFA Rules not processed for user `ad345e132ab8480bae8000b8f6a65ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:40.922903 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d1ce54dc-93a8-4154-9922-f025f8c44d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:40.987103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1156/2324] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:40 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:40.997261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:40.998994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:41.052980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cf481-3c1c-41d5-83d5-3a939e20a51f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:41.056395 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08441326-6a43-4924-ab4c-7d869b8857b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:41.057022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08441326-6a43-4924-ab4c-7d869b8857b0 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.057301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08441326-6a43-4924-ab4c-7d869b8857b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.057571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08441326-6a43-4924-ab4c-7d869b8857b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.066055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08441326-6a43-4924-ab4c-7d869b8857b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:41.067476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08441326-6a43-4924-ab4c-7d869b8857b0 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:41.075466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1169/2325] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:40 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:41.095063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce54dc-93a8-4154-9922-f025f8c44d3d None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:41.154893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce54dc-93a8-4154-9922-f025f8c44d3d None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:41.159203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:41.160086 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.160362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.160630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] PATH_INFO: `/v3/users/ad345e132ab8480bae8000b8f6a65ed8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.161761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad345e132ab8480bae8000b8f6a65ed8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:41.163698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:41.209233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad345e132ab8480bae8000b8f6a65ed8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.220639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad345e132ab8480bae8000b8f6a65ed8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.221300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad345e132ab8480bae8000b8f6a65ed8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.228412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad345e132ab8480bae8000b8f6a65ed8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.228906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad345e132ab8480bae8000b8f6a65ed8'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.240451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1157/2326] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:40:41 2021] DELETE /identity/v3/users/ad345e132ab8480bae8000b8f6a65ed8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:41.244953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fcf9c-af10-4fcd-b7cb-02a22f5567c9 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.245246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fcf9c-af10-4fcd-b7cb-02a22f5567c9 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.245551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fcf9c-af10-4fcd-b7cb-02a22f5567c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.262515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-592fcf9c-af10-4fcd-b7cb-02a22f5567c9 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:41.264344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-592fcf9c-af10-4fcd-b7cb-02a22f5567c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:41.318610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1170/2327] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:41.328946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:41.330254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:41.383089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596c9ee-0d4c-4399-b46d-fb57774a041b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:41.386529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef85b-c220-46aa-9f0f-49e20edc2a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:41.387163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef85b-c220-46aa-9f0f-49e20edc2a94 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.387445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef85b-c220-46aa-9f0f-49e20edc2a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.387727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef85b-c220-46aa-9f0f-49e20edc2a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.396735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef85b-c220-46aa-9f0f-49e20edc2a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:41.398158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef85b-c220-46aa-9f0f-49e20edc2a94 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:41.406816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1158/2328] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:40:41.683540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fcf9c-af10-4fcd-b7cb-02a22f5567c9 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:41.685104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-592fcf9c-af10-4fcd-b7cb-02a22f5567c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:41.702731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fcf9c-af10-4fcd-b7cb-02a22f5567c9 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:41.707473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:41.708381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.708686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.708954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] PATH_INFO: `/v3/projects/9d8183d1b3aa40bfac4be3ffc61a8e64` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.710100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8183d1b3aa40bfac4be3ffc61a8e64)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:41.712047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:41.756642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8183d1b3aa40bfac4be3ffc61a8e64', 'request_id': 'req-3255e1f9-300e-46ba-b867-a7284ef2df42'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.762273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8183d1b3aa40bfac4be3ffc61a8e64', 'request_id': 'req-3255e1f9-300e-46ba-b867-a7284ef2df42'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.769597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8183d1b3aa40bfac4be3ffc61a8e64', 'request_id': 'req-3255e1f9-300e-46ba-b867-a7284ef2df42'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.779562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] The token cache is being invalidate because project 9d8183d1b3aa40bfac4be3ffc61a8e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:40:41.779871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.780480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3255e1f9-300e-46ba-b867-a7284ef2df42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:40:41.781967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1171/2329] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:40:41 2021] DELETE /identity/v3/projects/9d8183d1b3aa40bfac4be3ffc61a8e64 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:40:41.789248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded37d6-4d5b-49b4-9e27-5156cc4fd254 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.789674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded37d6-4d5b-49b4-9e27-5156cc4fd254 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.789808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded37d6-4d5b-49b4-9e27-5156cc4fd254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.807236 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8ded37d6-4d5b-49b4-9e27-5156cc4fd254 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:41.808444 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8ded37d6-4d5b-49b4-9e27-5156cc4fd254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:41.873876 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1159/2330] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:41.881332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a08ff-dc01-44ba-b12a-4406556c4d4f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.881726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a08ff-dc01-44ba-b12a-4406556c4d4f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.882012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a08ff-dc01-44ba-b12a-4406556c4d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.900580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-f02a08ff-dc01-44ba-b12a-4406556c4d4f None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:41.901776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f02a08ff-dc01-44ba-b12a-4406556c4d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:41.911026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1172/2331] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:40:41.915418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded37d6-4d5b-49b4-9e27-5156cc4fd254 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:41.925621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded37d6-4d5b-49b4-9e27-5156cc4fd254 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:41.936343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:41.937011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.937291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.937564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.938299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:40:41.938605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:41.940247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:41.952981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1160/2332] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:40:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:40:41.957268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a08ff-dc01-44ba-b12a-4406556c4d4f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:41.965572 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a08ff-dc01-44ba-b12a-4406556c4d4f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:41.971317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671848f0-844b-4303-b44d-a400c29ff997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:41.971995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671848f0-844b-4303-b44d-a400c29ff997 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:41.972268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671848f0-844b-4303-b44d-a400c29ff997 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:41.972546 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671848f0-844b-4303-b44d-a400c29ff997 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:41.973221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671848f0-844b-4303-b44d-a400c29ff997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:41.975101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671848f0-844b-4303-b44d-a400c29ff997 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:42.007290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1173/2333] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:40:41 2021] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:40:42.008550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:42.019358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20fe14-f7bd-4234-a1f8-a2989ad24030 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:42.077796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e4e73-e090-4a5f-969e-86279c42e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:42.078527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e4e73-e090-4a5f-969e-86279c42e312 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:42.078751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e4e73-e090-4a5f-969e-86279c42e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:42.079030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e4e73-e090-4a5f-969e-86279c42e312 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:42.079791 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e4e73-e090-4a5f-969e-86279c42e312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:42.081722 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e4e73-e090-4a5f-969e-86279c42e312 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:42.102603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1161/2334] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:40:42 2021] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:40:42.112525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671848f0-844b-4303-b44d-a400c29ff997 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:42.122710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671848f0-844b-4303-b44d-a400c29ff997 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:42.129554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c3fb3-0a16-4038-8eca-69c3c9215f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:42.130267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c3fb3-0a16-4038-8eca-69c3c9215f24 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:42.130551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c3fb3-0a16-4038-8eca-69c3c9215f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:42.130835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c3fb3-0a16-4038-8eca-69c3c9215f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:42.131548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c3fb3-0a16-4038-8eca-69c3c9215f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:42.133197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c3fb3-0a16-4038-8eca-69c3c9215f24 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:42.144147 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1174/2335] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:40:42.148862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e4e73-e090-4a5f-969e-86279c42e312 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:42.160107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e4e73-e090-4a5f-969e-86279c42e312 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:42.165188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463beb0-fdee-47aa-a9e8-70faa8d21a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:42.165877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463beb0-fdee-47aa-a9e8-70faa8d21a47 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:42.166149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463beb0-fdee-47aa-a9e8-70faa8d21a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:42.166424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463beb0-fdee-47aa-a9e8-70faa8d21a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:42.167181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463beb0-fdee-47aa-a9e8-70faa8d21a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:42.168840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463beb0-fdee-47aa-a9e8-70faa8d21a47 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:42.182358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1162/2336] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:40:42 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:40:42.187054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c3fb3-0a16-4038-8eca-69c3c9215f24 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:42.197899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c3fb3-0a16-4038-8eca-69c3c9215f24 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:42.202987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:42.203901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:42.204185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:42.204459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] PATH_INFO: `/v3/projects/bd48ecb22cb04b3293e7bf8efaa3e1c6/users/442326f6e4c449f7bc7b11f890132dd5/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:42.219702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd48ecb22cb04b3293e7bf8efaa3e1c6, user_id=442326f6e4c449f7bc7b11f890132dd5, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:42.223560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:42.238889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1175/2337] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:40:42 2021] PUT /identity/v3/projects/bd48ecb22cb04b3293e7bf8efaa3e1c6/users/442326f6e4c449f7bc7b11f890132dd5/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:40:42.249328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56f3e-a168-4c66-a6cf-e737e0678830 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:42.249742 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56f3e-a168-4c66-a6cf-e737e0678830 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:42.250298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56f3e-a168-4c66-a6cf-e737e0678830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:42.283117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-8fd56f3e-a168-4c66-a6cf-e737e0678830 None None] MFA Rules not processed for user `442326f6e4c449f7bc7b11f890132dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:40:42.284252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8fd56f3e-a168-4c66-a6cf-e737e0678830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:42.347679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1163/2338] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:40:42 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:40:42.359119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:40:42.360914 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:40:42.415575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ded83-a380-4d22-a903-759ce6147031 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:40:42.419093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:40:42.420184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:42.420467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:42.420741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:42.428540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:40:42.429950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:40:42.438471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1176/2339] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:40:42 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:41:27.070160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd56f3e-a168-4c66-a6cf-e737e0678830 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:27.071542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8fd56f3e-a168-4c66-a6cf-e737e0678830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:27.159244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd56f3e-a168-4c66-a6cf-e737e0678830 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:27.163962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:27.164605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:27.164881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:27.165149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:27.166871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:27.178129 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:27.179694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:27.189204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1164/2340] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:41:27 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:42:25.711772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:25.713154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:25.767460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4021f-7e57-4f19-972f-e0ca4be3dc7c service glance] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:25.770915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:25.771552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:25.771860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:25.772135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:25.773810 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:25.782371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:25.783811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:25.790958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1177/2341] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:42:25 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:42:27.433916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.435374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:27.491066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954083a-f0d7-4a35-9705-6a254a05f147 service placement] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.494482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.495111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.495389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.495658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.497353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:27.554680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:27.556144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:27.564823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1165/2342] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:42:27 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:42:28.905600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.914376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccf204-399d-4e03-b18b-c7605a2161aa service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.917800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.918433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.918713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.918991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.920713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:28.999366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.000753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.021396 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1178/2343] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:42:28 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:42:29.497517 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.506486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5959b2-0797-4ec9-99da-17c8cadd242c service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.509927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.510561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.510838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.511109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.512819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:29.568934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.570278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.578542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1166/2344] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:42:29 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:42:30.204425 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.206373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:30.216332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c002be-3e4e-4a2a-b38f-7fe3b89bfc74 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.219889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.221397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.221681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.221952 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.223630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:30.236677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.238096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.248138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1179/2345] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:42:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:42:44.989976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:44.991373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:45.007098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d25e0d-82db-483b-a1b3-0368d3cdd75a service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.012228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.012866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.013143 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.013416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.015095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:45.026669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.028283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.038567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1167/2346] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:42:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:44:17.559568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:17.560907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:17.573837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbc186-079e-43a9-b84c-2be2882f994a service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:17.579002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:17.579638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:17.579961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:17.580237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:17.581887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:17.636677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:17.638298 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:17.646896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1180/2347] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:44:17 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:44:41.414030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:41.422729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d88fa7-0006-494e-b427-eb7ee9bb7730 service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:41.427106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:41.427774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:41.428057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:41.428408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:41.430123 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:41.493766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:41.495217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:41.505307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1168/2348] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:44:41 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:44:41.678163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:41.686699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980a5c9-84cb-4759-8f56-ef9093572d03 service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:41.690052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:41.690679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:41.690958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:41.691229 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:41.693695 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:41.748301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:41.749731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:41.758803 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1181/2349] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:44:41 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:45:42.961820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:42.969878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1c9d0-9fa9-4d56-ac9a-f679f998bf14 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:42.974021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df17bd-086d-42c3-b2f2-2db1170024f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:42.974654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df17bd-086d-42c3-b2f2-2db1170024f5 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:42.974931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df17bd-086d-42c3-b2f2-2db1170024f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:42.975200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df17bd-086d-42c3-b2f2-2db1170024f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:42.983015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df17bd-086d-42c3-b2f2-2db1170024f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:42.984506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df17bd-086d-42c3-b2f2-2db1170024f5 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:42.993543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1169/2350] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:45:42 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:46:26.986514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:26.988571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:27.001752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f6f55-40e8-47d3-bbe0-c3dbeaeb1fd9 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:27.007180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4457d-e485-434a-afb1-09735e15d9ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:27.007842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4457d-e485-434a-afb1-09735e15d9ff service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:27.008124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4457d-e485-434a-afb1-09735e15d9ff service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:27.008399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4457d-e485-434a-afb1-09735e15d9ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:27.016184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4457d-e485-434a-afb1-09735e15d9ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:27.017754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4457d-e485-434a-afb1-09735e15d9ff service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:27.028053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1182/2351] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:46:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:46:42.911125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df17bd-086d-42c3-b2f2-2db1170024f5 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:42.969039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df17bd-086d-42c3-b2f2-2db1170024f5 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:42.973873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:42.974729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:42.975006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:42.975278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] PATH_INFO: `/v3/users/442326f6e4c449f7bc7b11f890132dd5` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:42.976419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442326f6e4c449f7bc7b11f890132dd5)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:42.978325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:43.023070 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442326f6e4c449f7bc7b11f890132dd5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.035064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442326f6e4c449f7bc7b11f890132dd5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.035934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442326f6e4c449f7bc7b11f890132dd5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.043305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442326f6e4c449f7bc7b11f890132dd5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.043985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442326f6e4c449f7bc7b11f890132dd5'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.056561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1170/2352] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:46:42 2021] DELETE /identity/v3/users/442326f6e4c449f7bc7b11f890132dd5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:46:43.061419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a9c9-5b30-448e-8fcc-89767ac37725 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.061882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a9c9-5b30-448e-8fcc-89767ac37725 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.061977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a9c9-5b30-448e-8fcc-89767ac37725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.080866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-a627a9c9-5b30-448e-8fcc-89767ac37725 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:43.081966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a627a9c9-5b30-448e-8fcc-89767ac37725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:43.139032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1183/2353] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:46:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:46:43.149256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:43.150807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:43.206317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809db22-ebe3-47b0-a677-654cd6c1fab6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:43.210063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443e572-5538-4aa6-93ea-d84554ef6acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:43.210738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443e572-5538-4aa6-93ea-d84554ef6acf service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.211021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443e572-5538-4aa6-93ea-d84554ef6acf service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.211298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443e572-5538-4aa6-93ea-d84554ef6acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.220040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443e572-5538-4aa6-93ea-d84554ef6acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:43.221457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443e572-5538-4aa6-93ea-d84554ef6acf service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:43.230825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1171/2354] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:46:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:46:43.580835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a9c9-5b30-448e-8fcc-89767ac37725 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:43.582279 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a627a9c9-5b30-448e-8fcc-89767ac37725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:43.593651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a9c9-5b30-448e-8fcc-89767ac37725 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:43.598864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:43.599745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.600135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.600437 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] PATH_INFO: `/v3/projects/bd48ecb22cb04b3293e7bf8efaa3e1c6` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.601588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd48ecb22cb04b3293e7bf8efaa3e1c6)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:43.603490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:43.654592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd48ecb22cb04b3293e7bf8efaa3e1c6', 'request_id': 'req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.661216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd48ecb22cb04b3293e7bf8efaa3e1c6', 'request_id': 'req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.667955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd48ecb22cb04b3293e7bf8efaa3e1c6', 'request_id': 'req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.678338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] The token cache is being invalidate because project bd48ecb22cb04b3293e7bf8efaa3e1c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:46:43.678617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.679221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-47d9f89d-60ba-4a59-afbf-be5a71ab3f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:43.680780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1184/2355] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:46:43 2021] DELETE /identity/v3/projects/bd48ecb22cb04b3293e7bf8efaa3e1c6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:46:43.687874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9bd0d-0135-4e0b-855a-ca3ff9df1750 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.688281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9bd0d-0135-4e0b-855a-ca3ff9df1750 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.688565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9bd0d-0135-4e0b-855a-ca3ff9df1750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.705684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-bff9bd0d-0135-4e0b-855a-ca3ff9df1750 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:43.706923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bff9bd0d-0135-4e0b-855a-ca3ff9df1750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:43.763341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1172/2356] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:46:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:46:43.771741 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5984448-bc17-41eb-bc10-d0f674b65dbd None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.772025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5984448-bc17-41eb-bc10-d0f674b65dbd None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.772296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5984448-bc17-41eb-bc10-d0f674b65dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.790700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-c5984448-bc17-41eb-bc10-d0f674b65dbd None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:43.791892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c5984448-bc17-41eb-bc10-d0f674b65dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:43.799490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1185/2357] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:46:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:46:43.803651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9bd0d-0135-4e0b-855a-ca3ff9df1750 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:43.812632 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9bd0d-0135-4e0b-855a-ca3ff9df1750 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:43.817009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:43.817650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.817932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.818207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.818931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:43.819236 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:43.820877 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:43.832483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1173/2358] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:46:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:46:43.836644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5984448-bc17-41eb-bc10-d0f674b65dbd None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:43.845070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5984448-bc17-41eb-bc10-d0f674b65dbd None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:43.850408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fd863-0d69-4b82-850d-1f5127a9c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:43.851054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd863-0d69-4b82-850d-1f5127a9c2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.851360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd863-0d69-4b82-850d-1f5127a9c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.851634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd863-0d69-4b82-850d-1f5127a9c2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.852353 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fd863-0d69-4b82-850d-1f5127a9c2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:43.854234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fd863-0d69-4b82-850d-1f5127a9c2b1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:43.886718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1186/2359] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:46:43 2021] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:46:43.890854 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:43.900807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4659-1454-4139-82b7-1af81876e432 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:43.953392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e69722-e776-48af-9dea-b66390aae908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:43.954073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69722-e776-48af-9dea-b66390aae908 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.954338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69722-e776-48af-9dea-b66390aae908 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.954615 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69722-e776-48af-9dea-b66390aae908 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.955288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e69722-e776-48af-9dea-b66390aae908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:43.957799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e69722-e776-48af-9dea-b66390aae908 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:43.977530 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1174/2360] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:46:43 2021] POST /identity/v3/users => generated 280 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:46:43.981527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fd863-0d69-4b82-850d-1f5127a9c2b1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:43.991046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fd863-0d69-4b82-850d-1f5127a9c2b1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:43.995406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c942990-8597-4f7d-a35e-a2f632b09569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:43.996086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c942990-8597-4f7d-a35e-a2f632b09569 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:43.996368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c942990-8597-4f7d-a35e-a2f632b09569 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:43.996645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c942990-8597-4f7d-a35e-a2f632b09569 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:43.997363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c942990-8597-4f7d-a35e-a2f632b09569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:43.998947 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c942990-8597-4f7d-a35e-a2f632b09569 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:44.008462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1187/2361] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:46:43 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:46:44.012254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e69722-e776-48af-9dea-b66390aae908 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:44.022114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e69722-e776-48af-9dea-b66390aae908 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:44.026724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab05463-72cc-471e-ae01-4df03df463f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:44.027388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05463-72cc-471e-ae01-4df03df463f4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:44.027671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05463-72cc-471e-ae01-4df03df463f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:44.028163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05463-72cc-471e-ae01-4df03df463f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:44.028920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab05463-72cc-471e-ae01-4df03df463f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:44.030513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab05463-72cc-471e-ae01-4df03df463f4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:44.040486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1175/2362] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:46:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:46:44.044345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c942990-8597-4f7d-a35e-a2f632b09569 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:44.054175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c942990-8597-4f7d-a35e-a2f632b09569 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:44.058633 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:44.059536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:44.060472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:44.060472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] PATH_INFO: `/v3/projects/c7e79a56cdd54c879741380a92d44980/users/31b8f2c01665413abf9f5f1b8cba5d64/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:44.075040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e79a56cdd54c879741380a92d44980, user_id=31b8f2c01665413abf9f5f1b8cba5d64, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:44.077743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:44.091240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1188/2363] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:46:44 2021] PUT /identity/v3/projects/c7e79a56cdd54c879741380a92d44980/users/31b8f2c01665413abf9f5f1b8cba5d64/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:46:44.102186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40dd7f-9d82-4190-a1b2-2177fb04ed62 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:44.102474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40dd7f-9d82-4190-a1b2-2177fb04ed62 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:44.102752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40dd7f-9d82-4190-a1b2-2177fb04ed62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:44.130200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9d40dd7f-9d82-4190-a1b2-2177fb04ed62 None None] MFA Rules not processed for user `31b8f2c01665413abf9f5f1b8cba5d64`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:44.131633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9d40dd7f-9d82-4190-a1b2-2177fb04ed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:44.194173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1176/2364] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:46:44 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:46:44.220555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:44.222697 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:44.275727 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e763d-1433-4284-8320-7eaeccddcdde admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:44.279205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361e9e-4711-441e-a603-40912a57a74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:44.279869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361e9e-4711-441e-a603-40912a57a74b service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:44.280156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361e9e-4711-441e-a603-40912a57a74b service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:44.280425 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361e9e-4711-441e-a603-40912a57a74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:44.288906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54361e9e-4711-441e-a603-40912a57a74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:44.290325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54361e9e-4711-441e-a603-40912a57a74b service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:44.298290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1189/2365] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:46:44 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:46:44.313385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40dd7f-9d82-4190-a1b2-2177fb04ed62 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:44.374301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40dd7f-9d82-4190-a1b2-2177fb04ed62 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:44.378764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:44.379621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:44.379932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:44.380210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] PATH_INFO: `/v3/users/31b8f2c01665413abf9f5f1b8cba5d64` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:44.381365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b8f2c01665413abf9f5f1b8cba5d64)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:44.383281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:44.428156 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b8f2c01665413abf9f5f1b8cba5d64'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:44.439494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b8f2c01665413abf9f5f1b8cba5d64'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:44.440216 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b8f2c01665413abf9f5f1b8cba5d64'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:44.447683 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b8f2c01665413abf9f5f1b8cba5d64'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:44.448359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b8f2c01665413abf9f5f1b8cba5d64'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:44.460113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1177/2366] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:46:44 2021] DELETE /identity/v3/users/31b8f2c01665413abf9f5f1b8cba5d64 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:46:44.464714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249154e7-0c60-428f-94b4-dbfd14cbb810 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:44.465004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249154e7-0c60-428f-94b4-dbfd14cbb810 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:44.465283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249154e7-0c60-428f-94b4-dbfd14cbb810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:44.482888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-249154e7-0c60-428f-94b4-dbfd14cbb810 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:44.484047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-249154e7-0c60-428f-94b4-dbfd14cbb810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:44.540718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1190/2367] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:46:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:46:44.550452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:44.551783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:44.605608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699d3d1-30da-4dfc-a933-f9e75e19d8e7 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:44.608998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:44.609629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:44.609907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:44.610179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:44.618765 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:44.620220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:44.628917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1178/2368] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:46:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:46:44.966072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249154e7-0c60-428f-94b4-dbfd14cbb810 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:44.967481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-249154e7-0c60-428f-94b4-dbfd14cbb810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:44.978825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249154e7-0c60-428f-94b4-dbfd14cbb810 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:44.983246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:44.984132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:44.984416 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:44.984688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] PATH_INFO: `/v3/projects/c7e79a56cdd54c879741380a92d44980` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:44.985862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e79a56cdd54c879741380a92d44980)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:44.988512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:45.033832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e79a56cdd54c879741380a92d44980', 'request_id': 'req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:45.040100 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e79a56cdd54c879741380a92d44980', 'request_id': 'req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:45.047150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e79a56cdd54c879741380a92d44980', 'request_id': 'req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:45.058182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] The token cache is being invalidate because project c7e79a56cdd54c879741380a92d44980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:46:45.058466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:45.059099 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:46:45.060679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1191/2369] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:46:44 2021] DELETE /identity/v3/projects/c7e79a56cdd54c879741380a92d44980 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:47:27.699118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:47:27.700462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:27.756689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015fe1-9353-4454-b0d5-ce9f72a4dd83 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:47:27.809047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:47:27.809701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:47:27.809981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:47:27.810256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:47:27.812149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:27.892210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:47:27.893652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:47:27.912140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1179/2370] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:47:27 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:47:30.031591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:47:30.032996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:30.088654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f4f72-2d61-4e24-8adf-7e9d467fa6ca admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:47:30.092186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:47:30.092763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:47:30.093043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:47:30.093311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:47:30.095038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:30.164028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:47:30.165465 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:47:30.175379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1192/2371] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:47:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:47:30.281059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:47:30.282402 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:30.296837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a050390-6b59-40f9-abe8-eab649b9bf8c service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:47:30.302750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:47:30.303389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:47:30.303668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:47:30.303969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:47:30.305642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:30.384007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:47:30.385531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:47:30.403684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1180/2372] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:47:30 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:47:31.696798 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:47:31.698208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:31.708592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c50e49-9f36-4e5e-83c1-c813112fed81 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:47:31.711970 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:47:31.712610 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:47:31.712886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:47:31.713158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:47:31.714786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:31.724280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:47:31.725686 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:47:31.732969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1193/2373] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:47:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:47:33.343133 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:47:33.354019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee59ee-1d2f-40ee-a1eb-ee51af5ceef0 service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:47:33.359781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:47:33.360558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:47:33.360913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:47:33.361371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:47:33.363107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:47:33.376834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:47:33.378373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:47:33.389677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1181/2374] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:47:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:48:30.462893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:48:30.476159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c779ad-1510-4ba6-b639-1df84ab3401a service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:48:30.481291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28049153-a101-4028-9df8-59eb58794fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:48:30.481932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049153-a101-4028-9df8-59eb58794fac service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:48:30.482213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049153-a101-4028-9df8-59eb58794fac service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:48:30.482486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049153-a101-4028-9df8-59eb58794fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:48:30.484281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-28049153-a101-4028-9df8-59eb58794fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:48:30.495896 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28049153-a101-4028-9df8-59eb58794fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:48:30.497498 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28049153-a101-4028-9df8-59eb58794fac service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:48:30.507399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1194/2375] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:48:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:49:17.634300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:49:17.645273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378553f-1be8-4937-b1dd-219fdba1c9be service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:49:17.651785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:49:17.652432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:49:17.652717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:49:17.652994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:49:17.654714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:17.731257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:49:17.732870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:49:17.750225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1182/2376] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:49:17 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:49:36.816116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c50c6-0da0-40b6-9f84-1cedc864bf1f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:49:36.816636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c50c6-0da0-40b6-9f84-1cedc864bf1f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:49:36.816750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c50c6-0da0-40b6-9f84-1cedc864bf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:49:36.842306 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ac8c50c6-0da0-40b6-9f84-1cedc864bf1f None None] MFA Rules not processed for user `fd82b48aabbb419cb891867d0b1a57e0`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:49:36.843468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ac8c50c6-0da0-40b6-9f84-1cedc864bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:36.850523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1195/2377] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:49:36 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:49:37.142614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:49:37.151497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb73040-7b80-4760-9d8a-8c6147cb3680 service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:49:37.154948 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:49:37.155581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:49:37.155893 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:49:37.156167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:49:37.157841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:37.166688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:49:37.168301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:49:37.176600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1183/2378] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:49:37 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:49:37.494607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c50c6-0da0-40b6-9f84-1cedc864bf1f None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:49:37.496278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ac8c50c6-0da0-40b6-9f84-1cedc864bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:37.564657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c50c6-0da0-40b6-9f84-1cedc864bf1f None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:49:37.569557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:49:37.570201 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:49:37.570544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:49:37.570757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:49:37.572497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:37.583501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:49:37.585181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:49:37.594393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1196/2379] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:49:37 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:49:37.699452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:49:37.700811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:37.714834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ebe49-804e-4d62-afed-1b28583d1014 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:49:37.719516 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:49:37.720186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:49:37.720473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:49:37.720745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:49:37.723037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:37.733797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:49:37.735368 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:49:37.744819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1184/2380] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:49:37 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:49:41.864776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:49:41.866227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:41.881314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa640ef-2e01-445d-a0ed-57c3592c534c service placement] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:49:41.885419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:49:41.886522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:49:41.887033 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:49:41.887522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:49:41.889779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:41.968609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:49:41.970040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:49:41.987934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1197/2381] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:49:41 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:49:42.075412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:49:42.084821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fee9d-0fef-4d52-aaaa-ba1366cb470e service placement] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:49:42.088227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:49:42.088855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:49:42.089133 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:49:42.089405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:49:42.091102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:42.171904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:49:42.173357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:49:42.192305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1185/2382] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:49:42 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:49:46.914026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:49:46.927615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7581b6-d3fa-4a40-b291-55dd45119fc2 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:49:46.932706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:49:46.933371 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:49:46.933648 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:49:46.933920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:49:46.935601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:49:46.947140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:49:46.948732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:49:46.958893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1198/2383] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:49:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:51:32.605568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:51:32.662774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1523ddf-7269-494c-8a91-74034e30c660 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:51:32.668348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:51:32.668988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:51:32.669275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:51:32.669550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:51:32.671269 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:51:32.703157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:51:32.704776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:51:32.714012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1186/2384] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:51:32 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:51:34.243190 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:51:34.280239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fcffd-54b2-484b-b42e-2c99f792d41b service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:51:34.283843 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:51:34.284517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:51:34.284801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:51:34.285096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:51:34.286820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:51:34.371892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:51:34.373327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:51:34.390763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1199/2385] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:51:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:51:41.526041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:51:41.528104 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:51:41.547279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243163e5-b320-4680-8180-6a9f02f959ea service placement] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:51:41.551755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:51:41.552636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:51:41.552963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:51:41.553237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] PATH_INFO: `/v3/users/b539456ade66487fabf02e41879bbb45` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:51:41.556839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b539456ade66487fabf02e41879bbb45)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:51:41.559094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:51:41.609321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b539456ade66487fabf02e41879bbb45'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.621693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b539456ade66487fabf02e41879bbb45'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.622384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b539456ade66487fabf02e41879bbb45'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.636226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b539456ade66487fabf02e41879bbb45'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.636226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b539456ade66487fabf02e41879bbb45'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.642544 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1187/2386] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:51:41 2021] DELETE /identity/v3/users/b539456ade66487fabf02e41879bbb45 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:51:41.811858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:51:41.821253 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e838d-456a-48ea-8235-11b97fb82657 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:51:41.876774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:51:41.877630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:51:41.877907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:51:41.878176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] PATH_INFO: `/v3/projects/dcfeb19e3a6d42cfbf29ba7e9a7aeacf` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:51:41.879286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfeb19e3a6d42cfbf29ba7e9a7aeacf)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:51:41.881464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:51:41.924366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'request_id': 'req-1254047a-6354-4e4e-91d9-751ad7e769cc'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.930881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'request_id': 'req-1254047a-6354-4e4e-91d9-751ad7e769cc'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.938338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'request_id': 'req-1254047a-6354-4e4e-91d9-751ad7e769cc'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.948420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] The token cache is being invalidate because project dcfeb19e3a6d42cfbf29ba7e9a7aeacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:51:41.948705 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.949326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:41.951018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1200/2387] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:51:41 2021] DELETE /identity/v3/projects/dcfeb19e3a6d42cfbf29ba7e9a7aeacf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:51:41.954984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:51:41.956418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:51:41.969115 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb7e6e-1e13-494c-82c9-ad4f9897f323 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:51:42.025761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:51:42.026644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:51:42.026923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:51:42.027219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] PATH_INFO: `/v3/users/8d690951a63449a4b967727eb2a188a3` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:51:42.041144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d690951a63449a4b967727eb2a188a3)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:51:42.043083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:51:42.090476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d690951a63449a4b967727eb2a188a3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.103600 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d690951a63449a4b967727eb2a188a3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.104370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d690951a63449a4b967727eb2a188a3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.111800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d690951a63449a4b967727eb2a188a3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.112728 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d690951a63449a4b967727eb2a188a3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.125310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1188/2388] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:51:41 2021] DELETE /identity/v3/users/8d690951a63449a4b967727eb2a188a3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:51:42.295978 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:51:42.297384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:51:42.310223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254047a-6354-4e4e-91d9-751ad7e769cc admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:51:42.364982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:51:42.365946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:51:42.366160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:51:42.366425 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] PATH_INFO: `/v3/projects/daa5767c8c514b27b56c92e463dbf2cc` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:51:42.376763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa5767c8c514b27b56c92e463dbf2cc)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:51:42.378658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:51:42.422564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa5767c8c514b27b56c92e463dbf2cc', 'request_id': 'req-f2302500-7da9-4388-88ba-4f3099008944'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.428821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa5767c8c514b27b56c92e463dbf2cc', 'request_id': 'req-f2302500-7da9-4388-88ba-4f3099008944'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.435959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa5767c8c514b27b56c92e463dbf2cc', 'request_id': 'req-f2302500-7da9-4388-88ba-4f3099008944'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.446509 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] The token cache is being invalidate because project daa5767c8c514b27b56c92e463dbf2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:51:42.446790 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.447405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:51:42.448924 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1201/2389] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:51:42 2021] DELETE /identity/v3/projects/daa5767c8c514b27b56c92e463dbf2cc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:52:27.980708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:52:27.982098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:52:28.057816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054fae-10ed-46e3-8eb8-475be2297bcb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:52:28.104052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:52:28.104703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:52:28.104980 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:52:28.105255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:52:28.106998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:52:28.165896 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:52:28.167487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:52:28.176480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1189/2390] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:52:27 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:52:29.867616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:52:29.869003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:52:29.880888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2302500-7da9-4388-88ba-4f3099008944 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:52:29.884490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:52:29.885132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:52:29.885415 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:52:29.885717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:52:29.887431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:52:29.944827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:52:29.946576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:52:29.955381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1202/2391] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:52:29 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:52:37.548909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:52:37.550215 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:52:37.617313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf45f2-6f9d-41fe-800b-082796be4579 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:52:37.621055 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:52:37.621699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:52:37.621985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:52:37.622262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:52:37.624040 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:52:37.634997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:52:37.636512 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:52:37.658513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1190/2392] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:52:37 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:52:38.951918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:52:38.953182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:52:38.963784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d974d-a7b1-49f4-b39b-ee523fdb57ac service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:52:38.967121 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:52:38.967783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:52:38.968068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:52:38.968343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:52:38.969981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:52:39.054913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:52:39.056383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:52:39.075002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1203/2393] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:52:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:40.992083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:40.993531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:41.004393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313663ac-b6f0-4c2a-8637-2b341520d3c6 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:41.008887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfe3bd-04df-4ab3-a790-0d881c14ce96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:41.009568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfe3bd-04df-4ab3-a790-0d881c14ce96 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:41.009851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfe3bd-04df-4ab3-a790-0d881c14ce96 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:41.010267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfe3bd-04df-4ab3-a790-0d881c14ce96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:41.012188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-39cfe3bd-04df-4ab3-a790-0d881c14ce96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:41.073641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfe3bd-04df-4ab3-a790-0d881c14ce96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:41.075093 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfe3bd-04df-4ab3-a790-0d881c14ce96 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:41.083942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1191/2394] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:54:40 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:42.197278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:42.199355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:42.212006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9257c0-09f2-4fdc-adff-eb70b5415784 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:42.219000 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:42.219784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:42.220119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:42.220463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:42.222969 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:42.290375 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:42.292085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:42.301011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1204/2395] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:54:42 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:44.056858 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5134324-82f2-4e1d-9183-00bffd93dbd3 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:44.057351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5134324-82f2-4e1d-9183-00bffd93dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:44.057484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5134324-82f2-4e1d-9183-00bffd93dbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:44.082443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d5134324-82f2-4e1d-9183-00bffd93dbd3 None None] MFA Rules not processed for user `faf7da464d4c44db918dd6c5076846e9`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:44.083658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d5134324-82f2-4e1d-9183-00bffd93dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.090094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1192/2396] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:54:44 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:44.387309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:44.396406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7695e-632c-43a1-8ad2-2488233ac4eb service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:44.399750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:44.400386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:44.400668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:44.400945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:44.402627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.412025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:44.413470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:44.420927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1205/2397] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:54:44 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:44.723965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5134324-82f2-4e1d-9183-00bffd93dbd3 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:44.725288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d5134324-82f2-4e1d-9183-00bffd93dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.792312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5134324-82f2-4e1d-9183-00bffd93dbd3 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:44.796947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:44.797584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:44.797859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:44.798318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:44.800283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.811063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:44.812705 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:44.824064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1193/2398] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:54:44 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:44.929929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:44.931239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.945161 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02a05e-51e5-4222-a09b-0a82785b6a1c service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:44.949832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:44.950463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:44.950738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:44.951008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:44.952685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.963571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:44.965175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:44.974900 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1206/2399] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:54:44 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:47.222229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:47.246281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b91eab-0968-4bf7-a940-055415290037 service placement] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:47.254456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:47.255252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:47.255613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:47.255990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:47.258314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:47.293540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:47.296016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:47.313078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1194/2400] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:54:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:52.154575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:52.173066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5810c-39ce-4661-9387-83fbd49afe89 service placement] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:52.178486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:52.179156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:52.179435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:52.179744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:52.181464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:52.195070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:52.196677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:52.207529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1207/2401] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:54:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:38.951469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:56:38.961863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9d061-53b4-4d38-9584-de5421005f6d service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:56:38.966559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:56:38.967189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:38.967471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:38.967775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:38.969473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:38.980626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:56:38.982196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:56:38.991849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1195/2402] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:56:38 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:57:28.812787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:57:28.822018 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcae18-b556-4437-8247-7a3551689f39 service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:57:28.825416 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f3972-eed8-43fb-a3ad-52a599f47824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:57:28.826043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3972-eed8-43fb-a3ad-52a599f47824 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:57:28.826321 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3972-eed8-43fb-a3ad-52a599f47824 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:57:28.826591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3972-eed8-43fb-a3ad-52a599f47824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:57:28.835453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f3972-eed8-43fb-a3ad-52a599f47824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:57:28.836891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f3972-eed8-43fb-a3ad-52a599f47824 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:57:28.863850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1208/2403] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:57:28 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:57:30.422853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:57:30.432044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fee3d-aabc-449a-9511-bcba83ed1a97 service placement] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:57:30.435479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76a424-b5bf-4cd9-bada-cf990beaa625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:57:30.436173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a424-b5bf-4cd9-bada-cf990beaa625 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:57:30.436456 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a424-b5bf-4cd9-bada-cf990beaa625 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:57:30.436756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a424-b5bf-4cd9-bada-cf990beaa625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:57:30.445338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76a424-b5bf-4cd9-bada-cf990beaa625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:57:30.446757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76a424-b5bf-4cd9-bada-cf990beaa625 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:57:30.474420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1196/2404] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:57:30 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:57:41.674851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f3972-eed8-43fb-a3ad-52a599f47824 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:57:41.683545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f3972-eed8-43fb-a3ad-52a599f47824 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:57:41.686932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea11dc-fff3-4efd-b62e-9f4a67755e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:57:41.687558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea11dc-fff3-4efd-b62e-9f4a67755e23 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:57:41.687869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea11dc-fff3-4efd-b62e-9f4a67755e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:57:41.688144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea11dc-fff3-4efd-b62e-9f4a67755e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:57:41.695865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea11dc-fff3-4efd-b62e-9f4a67755e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:57:41.697275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea11dc-fff3-4efd-b62e-9f4a67755e23 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:57:41.704593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1209/2405] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:57:41 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:58:40.980803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76a424-b5bf-4cd9-bada-cf990beaa625 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:40.989413 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76a424-b5bf-4cd9-bada-cf990beaa625 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:40.993846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:40.994473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:40.994750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:40.995022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:41.004351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:41.005764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:41.016552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1197/2406] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:58:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:58:45.684672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea11dc-fff3-4efd-b62e-9f4a67755e23 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:45.692683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea11dc-fff3-4efd-b62e-9f4a67755e23 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:45.696369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:45.696998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:45.697278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:45.697551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:45.699288 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:45.757600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:45.759050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:45.767745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1210/2407] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:58:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:58:48.579756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:48.581146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:48.598732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4e48d-048b-44c8-8d81-6fa88fc28daf service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:48.604931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:48.605711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:48.605996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:48.606272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] PATH_INFO: `/v3/users/90c3a2e7255c4a909fc7e09730344930` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:48.607454 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c3a2e7255c4a909fc7e09730344930)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:48.609434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:48.663360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c3a2e7255c4a909fc7e09730344930'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:48.680724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c3a2e7255c4a909fc7e09730344930'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:48.681920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c3a2e7255c4a909fc7e09730344930'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:48.692954 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c3a2e7255c4a909fc7e09730344930'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:48.693562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-38e8ad02-6538-433f-9752-5180b3b285d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c3a2e7255c4a909fc7e09730344930'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:48.707682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1198/2408] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 03:58:48 2021] DELETE /identity/v3/users/90c3a2e7255c4a909fc7e09730344930 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:58:48.883927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:48.894358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62029498-ed72-48f4-b89e-ca29723aec6e service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:48.949261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:48.950114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:48.950392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:48.950667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] PATH_INFO: `/v3/projects/89e53e09771a4a478b48fa6e6f571d81` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:48.951825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e53e09771a4a478b48fa6e6f571d81)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:48.953717 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:48.997608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e53e09771a4a478b48fa6e6f571d81', 'request_id': 'req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:49.003427 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e53e09771a4a478b48fa6e6f571d81', 'request_id': 'req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:49.011203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e53e09771a4a478b48fa6e6f571d81', 'request_id': 'req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:49.020940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] The token cache is being invalidate because project 89e53e09771a4a478b48fa6e6f571d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:58:49.021219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:49.021849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-15cd6d02-ed3c-4f60-8509-abd718bf5cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:49.023494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1211/2409] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 03:58:48 2021] DELETE /identity/v3/projects/89e53e09771a4a478b48fa6e6f571d81 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:58:49.032136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368a4b-e51d-4f13-8efb-e118178f9d19 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.032497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368a4b-e51d-4f13-8efb-e118178f9d19 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.032840 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368a4b-e51d-4f13-8efb-e118178f9d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.089765 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-60368a4b-e51d-4f13-8efb-e118178f9d19 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:58:49.090934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-60368a4b-e51d-4f13-8efb-e118178f9d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:49.146469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1199/2410] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:58:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:58:49.154283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afce57-0b5e-455e-a231-6fab25ab5076 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.154574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afce57-0b5e-455e-a231-6fab25ab5076 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.154857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afce57-0b5e-455e-a231-6fab25ab5076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.172861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-29afce57-0b5e-455e-a231-6fab25ab5076 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:58:49.174026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-29afce57-0b5e-455e-a231-6fab25ab5076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:49.181847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1212/2411] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:58:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:58:49.186179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368a4b-e51d-4f13-8efb-e118178f9d19 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:49.195626 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368a4b-e51d-4f13-8efb-e118178f9d19 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:49.199946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:49.200594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.200875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.201146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.201857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:58:49.202157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:49.204030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:49.215747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1200/2412] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 03:58:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:58:49.219836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afce57-0b5e-455e-a231-6fab25ab5076 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:49.228448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afce57-0b5e-455e-a231-6fab25ab5076 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:49.232775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854ca69-1e28-41db-88da-5be8e5a878be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:49.233411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ca69-1e28-41db-88da-5be8e5a878be admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.233688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ca69-1e28-41db-88da-5be8e5a878be admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.233957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ca69-1e28-41db-88da-5be8e5a878be admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.234638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854ca69-1e28-41db-88da-5be8e5a878be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:49.236545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854ca69-1e28-41db-88da-5be8e5a878be admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:49.272124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1213/2413] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 03:58:49 2021] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:58:49.276213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:49.285355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55236342-5006-4459-85c5-9167d63e87dd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:49.340410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699ee18-f010-4389-8a3c-fca998153dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:49.340996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699ee18-f010-4389-8a3c-fca998153dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.341275 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699ee18-f010-4389-8a3c-fca998153dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.341548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699ee18-f010-4389-8a3c-fca998153dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.342225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699ee18-f010-4389-8a3c-fca998153dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:49.344145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699ee18-f010-4389-8a3c-fca998153dd9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:49.364053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1201/2414] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 03:58:49 2021] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:58:49.368933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854ca69-1e28-41db-88da-5be8e5a878be admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:49.378516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854ca69-1e28-41db-88da-5be8e5a878be admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:49.383338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e98b8-90e6-4f95-aaa7-e807797a6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:49.384024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e98b8-90e6-4f95-aaa7-e807797a6c36 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.384307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e98b8-90e6-4f95-aaa7-e807797a6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.384582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e98b8-90e6-4f95-aaa7-e807797a6c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.385294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e98b8-90e6-4f95-aaa7-e807797a6c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:49.386879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e98b8-90e6-4f95-aaa7-e807797a6c36 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:49.396545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1214/2415] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:58:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:58:49.400025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699ee18-f010-4389-8a3c-fca998153dd9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:49.409218 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699ee18-f010-4389-8a3c-fca998153dd9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:49.414237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76a109-8987-44e4-9e8d-f6b4781515ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:49.414889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a109-8987-44e4-9e8d-f6b4781515ad admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.415171 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a109-8987-44e4-9e8d-f6b4781515ad admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.415442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a109-8987-44e4-9e8d-f6b4781515ad admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.416188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76a109-8987-44e4-9e8d-f6b4781515ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:49.417767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76a109-8987-44e4-9e8d-f6b4781515ad admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:49.427409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1202/2416] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 03:58:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:58:49.431888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e98b8-90e6-4f95-aaa7-e807797a6c36 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:49.440792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e98b8-90e6-4f95-aaa7-e807797a6c36 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:49.445166 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:49.446024 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.446307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.446583 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] PATH_INFO: `/v3/projects/1702326da7164b51a0d5d6cbd7e4e277/users/3cb9295cda334fbbac03b3961098140e/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.460568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1702326da7164b51a0d5d6cbd7e4e277, user_id=3cb9295cda334fbbac03b3961098140e, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:49.463239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:49.476378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1215/2417] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 03:58:49 2021] PUT /identity/v3/projects/1702326da7164b51a0d5d6cbd7e4e277/users/3cb9295cda334fbbac03b3961098140e/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:58:49.487239 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115a6f8-27f7-4924-bc78-5e1c01fc9621 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.487528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115a6f8-27f7-4924-bc78-5e1c01fc9621 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.487849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115a6f8-27f7-4924-bc78-5e1c01fc9621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.513602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f115a6f8-27f7-4924-bc78-5e1c01fc9621 None None] MFA Rules not processed for user `3cb9295cda334fbbac03b3961098140e`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:58:49.514752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f115a6f8-27f7-4924-bc78-5e1c01fc9621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:49.575860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1203/2418] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 03:58:49 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:58:49.585965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:49.587589 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:49.641359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc8241-c7c5-4f21-b09d-f0c8797d56f3 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:49.644759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:49.645382 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:49.645662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:49.645931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:49.654179 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:49.655607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:49.664246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1216/2419] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:58:49 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:59:43.118262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115a6f8-27f7-4924-bc78-5e1c01fc9621 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:59:43.119533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f115a6f8-27f7-4924-bc78-5e1c01fc9621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:59:43.130578 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115a6f8-27f7-4924-bc78-5e1c01fc9621 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:59:43.134078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:59:43.134714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:59:43.135008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:59:43.135264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:59:43.136923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:59:43.212908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:59:43.214650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:59:43.232763 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1204/2420] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 03:59:43 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:01:35.138221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:01:35.139584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:01:35.318263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b971c7b-3475-490a-8327-c24e12777566 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:01:35.325165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:01:35.326181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:01:35.326698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:01:35.327155 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:01:35.329008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:01:35.341661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:01:35.343625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:01:35.354376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1217/2421] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:01:35 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:01:42.875334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:01:42.876669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:01:42.991423 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ca6a7-9162-4789-9f7a-df733930eee0 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:01:42.996969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:01:42.997604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:01:42.997883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:01:42.998155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:01:42.999936 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:01:43.010280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:01:43.011865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:01:43.021166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1205/2422] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:01:42 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:27.221811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:27.231411 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864400-10a0-48fc-9b5e-225770a5546e service nova] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:27.235534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:27.236219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:27.236504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:27.236780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:27.238550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:27.306143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:27.307570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:27.315787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1218/2423] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:02:27 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:29.902805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:29.921442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329647e-1537-430d-af8f-1e1f9d355342 service placement] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:29.924891 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:29.925528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:29.925808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:29.926080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:29.927850 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:29.994736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:29.996197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:30.004515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1206/2424] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:02:29 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:50.505737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:50.523430 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac99fe-91ff-458b-8f62-38e380bb9c68 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:50.527147 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:50.527854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:50.528139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:50.528413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:50.536905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:50.538322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:50.547263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1219/2425] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:03:50 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:42.895493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:42.903723 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27352f-abc1-44bd-95a8-b7301fe1224e service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:42.907254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d794f0-4107-4a9c-8615-e8e4a0532bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:42.907915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d794f0-4107-4a9c-8615-e8e4a0532bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:42.908196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d794f0-4107-4a9c-8615-e8e4a0532bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:42.908470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d794f0-4107-4a9c-8615-e8e4a0532bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:42.916377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d794f0-4107-4a9c-8615-e8e4a0532bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:42.917800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d794f0-4107-4a9c-8615-e8e4a0532bf1 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:42.926413 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1207/2426] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:04:42 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:06:47.893794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:47.895151 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:47.908409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf84d8c-2024-4f00-b245-19a2edf43755 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:47.913156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fbac7-677d-4030-8e1b-1f39bc24de29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:47.913712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbac7-677d-4030-8e1b-1f39bc24de29 service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:47.913994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbac7-677d-4030-8e1b-1f39bc24de29 service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:47.914261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbac7-677d-4030-8e1b-1f39bc24de29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:47.922563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fbac7-677d-4030-8e1b-1f39bc24de29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:47.924718 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fbac7-677d-4030-8e1b-1f39bc24de29 service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:47.934221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1220/2427] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:06:47 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:27.704426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d794f0-4107-4a9c-8615-e8e4a0532bf1 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:27.712364 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d794f0-4107-4a9c-8615-e8e4a0532bf1 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:27.715885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:27.716522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:27.716807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:27.717085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:27.726135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:27.727726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:27.736721 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1208/2428] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:07:27 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:29.797028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fbac7-677d-4030-8e1b-1f39bc24de29 service placement] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:29.806389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fbac7-677d-4030-8e1b-1f39bc24de29 service placement] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:29.809758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:29.810385 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:29.810661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:29.810930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:29.819453 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:29.820899 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:29.829144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1221/2429] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:07:29 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:30.090379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:30.091777 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:30.184097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2a0eb-3957-4285-885d-c16c1651e836 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:30.187636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:30.188324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:30.188606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:30.188882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:30.190580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:30.271021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:30.272418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:30.290867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1209/2430] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:08:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:33.556770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:33.558170 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:33.577888 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5ab70-eb07-494e-af3f-3b0c5e41f061 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:33.582088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:33.582956 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:33.583235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:33.583536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] PATH_INFO: `/v3/users/fd82b48aabbb419cb891867d0b1a57e0` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:33.584698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd82b48aabbb419cb891867d0b1a57e0)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:33.586600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:33.630732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd82b48aabbb419cb891867d0b1a57e0'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.642643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd82b48aabbb419cb891867d0b1a57e0'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.649101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd82b48aabbb419cb891867d0b1a57e0'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.649753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd82b48aabbb419cb891867d0b1a57e0'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.657647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3616b9cd-e668-46f9-bad9-310633bf7383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd82b48aabbb419cb891867d0b1a57e0'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.663325 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1222/2431] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:08:33 2021] DELETE /identity/v3/users/fd82b48aabbb419cb891867d0b1a57e0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:08:33.830743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:33.839922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33436a2e-9dcc-435d-a37e-075becccb3f5 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:33.897611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:33.898474 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:33.898762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:33.899038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] PATH_INFO: `/v3/projects/ee20ad097bcc4c51a357aa0a803f59a8` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:33.909662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee20ad097bcc4c51a357aa0a803f59a8)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:33.911575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:33.954679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee20ad097bcc4c51a357aa0a803f59a8', 'request_id': 'req-cbad8336-1813-4c85-8fc3-b8361121187c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.960969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee20ad097bcc4c51a357aa0a803f59a8', 'request_id': 'req-cbad8336-1813-4c85-8fc3-b8361121187c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.968250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee20ad097bcc4c51a357aa0a803f59a8', 'request_id': 'req-cbad8336-1813-4c85-8fc3-b8361121187c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.978551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] The token cache is being invalidate because project ee20ad097bcc4c51a357aa0a803f59a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:08:33.978837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.979453 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cbad8336-1813-4c85-8fc3-b8361121187c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:33.981232 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1210/2432] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:08:33 2021] DELETE /identity/v3/projects/ee20ad097bcc4c51a357aa0a803f59a8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:33.988799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22363-7365-43ae-b394-49bad9b64756 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:33.989089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22363-7365-43ae-b394-49bad9b64756 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:33.989366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22363-7365-43ae-b394-49bad9b64756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.006039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8fd22363-7365-43ae-b394-49bad9b64756 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:34.007237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8fd22363-7365-43ae-b394-49bad9b64756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:34.061092 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1223/2433] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:34.069166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000145d-4e27-4f71-ae33-36048febafe7 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.069460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000145d-4e27-4f71-ae33-36048febafe7 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.069779 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000145d-4e27-4f71-ae33-36048febafe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.087229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-4000145d-4e27-4f71-ae33-36048febafe7 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:34.088438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4000145d-4e27-4f71-ae33-36048febafe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:34.096536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1211/2434] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:34.100848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22363-7365-43ae-b394-49bad9b64756 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.110547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22363-7365-43ae-b394-49bad9b64756 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.114782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.115424 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.115701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.116001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.116709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:08:34.117009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.118616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.129811 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1224/2435] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:08:34.134147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000145d-4e27-4f71-ae33-36048febafe7 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.142662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000145d-4e27-4f71-ae33-36048febafe7 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.147083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a18bc-b04e-4bcf-8fbb-63f20c071204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.147756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a18bc-b04e-4bcf-8fbb-63f20c071204 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.148041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a18bc-b04e-4bcf-8fbb-63f20c071204 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.148314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a18bc-b04e-4bcf-8fbb-63f20c071204 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.148988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a18bc-b04e-4bcf-8fbb-63f20c071204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.150886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a18bc-b04e-4bcf-8fbb-63f20c071204 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.177376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1212/2436] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:08:34 2021] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:08:34.181464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.190754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c3412-c299-4705-931e-7361aa0c71d5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.244526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cbd20-a6c9-4420-a8d9-864d46b4e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.245186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cbd20-a6c9-4420-a8d9-864d46b4e0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.245466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cbd20-a6c9-4420-a8d9-864d46b4e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.245743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cbd20-a6c9-4420-a8d9-864d46b4e0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.246423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cbd20-a6c9-4420-a8d9-864d46b4e0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.248364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cbd20-a6c9-4420-a8d9-864d46b4e0b0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.268329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1225/2437] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:08:34 2021] POST /identity/v3/users => generated 282 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:08:34.272334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a18bc-b04e-4bcf-8fbb-63f20c071204 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.282965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a18bc-b04e-4bcf-8fbb-63f20c071204 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.287342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a643-e011-4a65-b7ad-03639e74c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.288080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a643-e011-4a65-b7ad-03639e74c056 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.288359 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a643-e011-4a65-b7ad-03639e74c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.288634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a643-e011-4a65-b7ad-03639e74c056 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.289384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a643-e011-4a65-b7ad-03639e74c056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.290976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a643-e011-4a65-b7ad-03639e74c056 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.301075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1213/2438] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:08:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:08:34.304803 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cbd20-a6c9-4420-a8d9-864d46b4e0b0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.313882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cbd20-a6c9-4420-a8d9-864d46b4e0b0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.318221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630dc6b-948c-40cc-ba64-39accc71030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.318875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630dc6b-948c-40cc-ba64-39accc71030d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.319154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630dc6b-948c-40cc-ba64-39accc71030d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.319428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630dc6b-948c-40cc-ba64-39accc71030d admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.320180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630dc6b-948c-40cc-ba64-39accc71030d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.321751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630dc6b-948c-40cc-ba64-39accc71030d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.331958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1226/2439] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:08:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:08:34.335804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a643-e011-4a65-b7ad-03639e74c056 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.345822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a643-e011-4a65-b7ad-03639e74c056 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.350142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab27a8-f8e5-4d8f-b511-3c1b7e25c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.351009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab27a8-f8e5-4d8f-b511-3c1b7e25c1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.351292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab27a8-f8e5-4d8f-b511-3c1b7e25c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.351567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab27a8-f8e5-4d8f-b511-3c1b7e25c1fc admin admin] PATH_INFO: `/v3/projects/fee1f6993d42466488f7314cff0b800e/users/bffb4a28f3e6408498e547162349f342/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.367997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab27a8-f8e5-4d8f-b511-3c1b7e25c1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee1f6993d42466488f7314cff0b800e, user_id=bffb4a28f3e6408498e547162349f342, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.370631 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab27a8-f8e5-4d8f-b511-3c1b7e25c1fc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.386717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1214/2440] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:08:34 2021] PUT /identity/v3/projects/fee1f6993d42466488f7314cff0b800e/users/bffb4a28f3e6408498e547162349f342/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:34.397630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b5e2-a0ed-4924-97d7-4ce8731dec71 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.397920 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b5e2-a0ed-4924-97d7-4ce8731dec71 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.398197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0b5e2-a0ed-4924-97d7-4ce8731dec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.425503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8de0b5e2-a0ed-4924-97d7-4ce8731dec71 None None] MFA Rules not processed for user `bffb4a28f3e6408498e547162349f342`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:34.433062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8de0b5e2-a0ed-4924-97d7-4ce8731dec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:34.489701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1227/2441] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:34 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:34.494178 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab27a8-f8e5-4d8f-b511-3c1b7e25c1fc admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.553230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab27a8-f8e5-4d8f-b511-3c1b7e25c1fc admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.557638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98857c2-6523-4398-a7d9-59d4ba8a89da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.558294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98857c2-6523-4398-a7d9-59d4ba8a89da admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.558576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98857c2-6523-4398-a7d9-59d4ba8a89da admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.558899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98857c2-6523-4398-a7d9-59d4ba8a89da admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.559529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98857c2-6523-4398-a7d9-59d4ba8a89da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.561816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98857c2-6523-4398-a7d9-59d4ba8a89da admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.591751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1215/2442] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:08:34 2021] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:08:34.594386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0b5e2-a0ed-4924-97d7-4ce8731dec71 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.604645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0b5e2-a0ed-4924-97d7-4ce8731dec71 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.661491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de558d-57e6-48a0-8c9d-eca052cabfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.662160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de558d-57e6-48a0-8c9d-eca052cabfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.662440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de558d-57e6-48a0-8c9d-eca052cabfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.662746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de558d-57e6-48a0-8c9d-eca052cabfb5 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.663392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de558d-57e6-48a0-8c9d-eca052cabfb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.665316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de558d-57e6-48a0-8c9d-eca052cabfb5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.685361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1228/2443] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:08:34 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:08:34.689405 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98857c2-6523-4398-a7d9-59d4ba8a89da admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.698815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98857c2-6523-4398-a7d9-59d4ba8a89da admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.703639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ea5c-0f40-4d88-bccc-67f2ac3890a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.704326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ea5c-0f40-4d88-bccc-67f2ac3890a5 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.704608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ea5c-0f40-4d88-bccc-67f2ac3890a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.704890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ea5c-0f40-4d88-bccc-67f2ac3890a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.705608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972ea5c-0f40-4d88-bccc-67f2ac3890a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.707208 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972ea5c-0f40-4d88-bccc-67f2ac3890a5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.717426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1216/2444] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:08:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:08:34.721902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de558d-57e6-48a0-8c9d-eca052cabfb5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.731392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de558d-57e6-48a0-8c9d-eca052cabfb5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.736783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f39b5-a4c2-4c69-802d-60f50dfdc33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.737642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f39b5-a4c2-4c69-802d-60f50dfdc33f admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.737917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f39b5-a4c2-4c69-802d-60f50dfdc33f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.738188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f39b5-a4c2-4c69-802d-60f50dfdc33f admin admin] PATH_INFO: `/v3/projects/ef2d63167740480885fbd97b95392f98/users/a5fe724292614656952d04f2e77cf0ce/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.752501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f39b5-a4c2-4c69-802d-60f50dfdc33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2d63167740480885fbd97b95392f98, user_id=a5fe724292614656952d04f2e77cf0ce, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.755106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f39b5-a4c2-4c69-802d-60f50dfdc33f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.767818 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1229/2445] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:08:34 2021] PUT /identity/v3/projects/ef2d63167740480885fbd97b95392f98/users/a5fe724292614656952d04f2e77cf0ce/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:08:34.771599 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ea5c-0f40-4d88-bccc-67f2ac3890a5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.781699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ea5c-0f40-4d88-bccc-67f2ac3890a5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.835438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f82ae7-931d-4420-9a85-940f4983f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.836106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f82ae7-931d-4420-9a85-940f4983f632 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.836321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f82ae7-931d-4420-9a85-940f4983f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.836597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f82ae7-931d-4420-9a85-940f4983f632 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.837301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f82ae7-931d-4420-9a85-940f4983f632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.838879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f82ae7-931d-4420-9a85-940f4983f632 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.849345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1217/2446] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:08:34 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:08:34.853129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f39b5-a4c2-4c69-802d-60f50dfdc33f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:34.863617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f39b5-a4c2-4c69-802d-60f50dfdc33f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:34.867945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:34.868825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.869106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.869378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] PATH_INFO: `/v3/projects/ef2d63167740480885fbd97b95392f98/users/a5fe724292614656952d04f2e77cf0ce/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.871167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2d63167740480885fbd97b95392f98, user_id=a5fe724292614656952d04f2e77cf0ce, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:34.874604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:34.884304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1230/2447] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:08:34 2021] PUT /identity/v3/projects/ef2d63167740480885fbd97b95392f98/users/a5fe724292614656952d04f2e77cf0ce/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:08:34.895528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c47c-c034-4952-bd99-cda7c44d5ded None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:34.895844 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c47c-c034-4952-bd99-cda7c44d5ded None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:34.896124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c47c-c034-4952-bd99-cda7c44d5ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:34.922036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-ae39c47c-c034-4952-bd99-cda7c44d5ded None None] MFA Rules not processed for user `a5fe724292614656952d04f2e77cf0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:34.923191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ae39c47c-c034-4952-bd99-cda7c44d5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:34.988161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1218/2448] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:34 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:08:34.998908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:35.000596 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:35.065632 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5becaa-c083-4534-8f60-c2ea69ce56b7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:35.069142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c291ec-96d1-4ba4-8d74-7447c779f54d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:35.069778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c291ec-96d1-4ba4-8d74-7447c779f54d service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:35.070064 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c291ec-96d1-4ba4-8d74-7447c779f54d service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:35.070345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c291ec-96d1-4ba4-8d74-7447c779f54d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:35.079289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c291ec-96d1-4ba4-8d74-7447c779f54d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:35.080745 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c291ec-96d1-4ba4-8d74-7447c779f54d service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:35.089342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1231/2449] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:08:34 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:08:35.229315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39c47c-c034-4952-bd99-cda7c44d5ded None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:35.288064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39c47c-c034-4952-bd99-cda7c44d5ded None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:35.292294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:35.293147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:35.293428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:35.293701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] PATH_INFO: `/v3/users/bffb4a28f3e6408498e547162349f342` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:35.294849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bffb4a28f3e6408498e547162349f342)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:35.296922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:35.340562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bffb4a28f3e6408498e547162349f342'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.352238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bffb4a28f3e6408498e547162349f342'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.352878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bffb4a28f3e6408498e547162349f342'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.359824 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bffb4a28f3e6408498e547162349f342'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.360462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bffb4a28f3e6408498e547162349f342'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.372050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1219/2450] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:08:35 2021] DELETE /identity/v3/users/bffb4a28f3e6408498e547162349f342 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:08:35.377106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc325-47df-4900-9350-970307ab860d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:35.377397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc325-47df-4900-9350-970307ab860d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:35.377677 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc325-47df-4900-9350-970307ab860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:35.394605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-7fffc325-47df-4900-9350-970307ab860d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:35.395779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7fffc325-47df-4900-9350-970307ab860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:35.457654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1232/2451] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:35.469964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:35.471314 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:35.528345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2412b6-971b-49f4-bba7-7bccb9452506 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:35.532553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fbc9c-a5f2-4f06-8794-7df49440cf62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:35.533190 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbc9c-a5f2-4f06-8794-7df49440cf62 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:35.533475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbc9c-a5f2-4f06-8794-7df49440cf62 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:35.533750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbc9c-a5f2-4f06-8794-7df49440cf62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:35.542214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fbc9c-a5f2-4f06-8794-7df49440cf62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:35.543630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fbc9c-a5f2-4f06-8794-7df49440cf62 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:35.553021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1220/2452] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:08:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:08:35.826765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc325-47df-4900-9350-970307ab860d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:35.829105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7fffc325-47df-4900-9350-970307ab860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:35.840319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc325-47df-4900-9350-970307ab860d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:35.845781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:35.846663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:35.846942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:35.847214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] PATH_INFO: `/v3/projects/fee1f6993d42466488f7314cff0b800e` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:35.848378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee1f6993d42466488f7314cff0b800e)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:35.850319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:35.895961 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee1f6993d42466488f7314cff0b800e', 'request_id': 'req-89ad0e82-1d61-40e9-8498-7051b58383b4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.901819 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee1f6993d42466488f7314cff0b800e', 'request_id': 'req-89ad0e82-1d61-40e9-8498-7051b58383b4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.909608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee1f6993d42466488f7314cff0b800e', 'request_id': 'req-89ad0e82-1d61-40e9-8498-7051b58383b4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.919384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] The token cache is being invalidate because project fee1f6993d42466488f7314cff0b800e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:08:35.919668 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.920326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.921875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1233/2453] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:08:35 2021] DELETE /identity/v3/projects/fee1f6993d42466488f7314cff0b800e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:35.925820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fbc9c-a5f2-4f06-8794-7df49440cf62 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:35.934636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fbc9c-a5f2-4f06-8794-7df49440cf62 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:35.989649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:35.990550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:35.990834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:35.991137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] PATH_INFO: `/v3/users/a5fe724292614656952d04f2e77cf0ce` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:35.992308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fe724292614656952d04f2e77cf0ce)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:35.994241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.040012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fe724292614656952d04f2e77cf0ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.052707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fe724292614656952d04f2e77cf0ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.053564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fe724292614656952d04f2e77cf0ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.061088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fe724292614656952d04f2e77cf0ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.061913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c7cd0b94-d3cd-4f37-8bfb-84985e7ee7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fe724292614656952d04f2e77cf0ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.075136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1221/2454] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:08:35 2021] DELETE /identity/v3/users/a5fe724292614656952d04f2e77cf0ce => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:36.349227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.350618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:36.363420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad0e82-1d61-40e9-8498-7051b58383b4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.418495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.419373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.419657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.419963 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] PATH_INFO: `/v3/projects/ef2d63167740480885fbd97b95392f98` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.421237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2d63167740480885fbd97b95392f98)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.423156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.468207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2d63167740480885fbd97b95392f98', 'request_id': 'req-12399cc0-0d72-47d4-9a92-e0f46e47055d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.474724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2d63167740480885fbd97b95392f98', 'request_id': 'req-12399cc0-0d72-47d4-9a92-e0f46e47055d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.483742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2d63167740480885fbd97b95392f98', 'request_id': 'req-12399cc0-0d72-47d4-9a92-e0f46e47055d'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.494503 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] The token cache is being invalidate because project ef2d63167740480885fbd97b95392f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:08:36.494784 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.495875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-12399cc0-0d72-47d4-9a92-e0f46e47055d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.497084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1234/2455] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:08:36 2021] DELETE /identity/v3/projects/ef2d63167740480885fbd97b95392f98 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:36.503899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a819b7-282c-43c9-8cbb-26290d1c91bd None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.504190 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a819b7-282c-43c9-8cbb-26290d1c91bd None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.504466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a819b7-282c-43c9-8cbb-26290d1c91bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.521755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-32a819b7-282c-43c9-8cbb-26290d1c91bd None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:36.522907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-32a819b7-282c-43c9-8cbb-26290d1c91bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:36.583690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1222/2456] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:36.591410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ef213-b212-458f-94ab-403ae240d15b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.591834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ef213-b212-458f-94ab-403ae240d15b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.592204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ef213-b212-458f-94ab-403ae240d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.610993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ea4ef213-b212-458f-94ab-403ae240d15b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:36.612217 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ea4ef213-b212-458f-94ab-403ae240d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:36.619434 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1235/2457] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:36.623424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a819b7-282c-43c9-8cbb-26290d1c91bd None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.633445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a819b7-282c-43c9-8cbb-26290d1c91bd None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.637809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.638457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.638743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.639020 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.639805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:08:36.640114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.641705 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.653075 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1223/2458] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:08:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:08:36.657345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ef213-b212-458f-94ab-403ae240d15b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.665706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ef213-b212-458f-94ab-403ae240d15b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.670064 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bad92-c785-4a38-be11-d04bcc9ec6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.671269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bad92-c785-4a38-be11-d04bcc9ec6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.671699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bad92-c785-4a38-be11-d04bcc9ec6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.672014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bad92-c785-4a38-be11-d04bcc9ec6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.672706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bad92-c785-4a38-be11-d04bcc9ec6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.674608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bad92-c785-4a38-be11-d04bcc9ec6e5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.699286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1236/2459] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:08:36 2021] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:08:36.703373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.712678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81048688-fe01-4c82-9cd7-74cac2eb6735 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.765714 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be193a52-5963-4853-b765-0747148d42b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.766377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be193a52-5963-4853-b765-0747148d42b6 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.766664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be193a52-5963-4853-b765-0747148d42b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.766943 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be193a52-5963-4853-b765-0747148d42b6 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.767622 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be193a52-5963-4853-b765-0747148d42b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.769561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be193a52-5963-4853-b765-0747148d42b6 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.788539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1224/2460] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:08:36 2021] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:08:36.792649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bad92-c785-4a38-be11-d04bcc9ec6e5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.803082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bad92-c785-4a38-be11-d04bcc9ec6e5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.807327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19525678-8b6a-42db-a3a4-adc7466d0682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.808004 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19525678-8b6a-42db-a3a4-adc7466d0682 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.808283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19525678-8b6a-42db-a3a4-adc7466d0682 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.808554 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19525678-8b6a-42db-a3a4-adc7466d0682 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.809263 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19525678-8b6a-42db-a3a4-adc7466d0682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.810847 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19525678-8b6a-42db-a3a4-adc7466d0682 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.821836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1237/2461] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:08:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:08:36.825566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be193a52-5963-4853-b765-0747148d42b6 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.834778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be193a52-5963-4853-b765-0747148d42b6 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.839095 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a2fa-6753-43f2-990f-25793e17ae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.839771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a2fa-6753-43f2-990f-25793e17ae47 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.840057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a2fa-6753-43f2-990f-25793e17ae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.840333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a2fa-6753-43f2-990f-25793e17ae47 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.841045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591a2fa-6753-43f2-990f-25793e17ae47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.843200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591a2fa-6753-43f2-990f-25793e17ae47 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.853122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1225/2462] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:08:36 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:08:36.857156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19525678-8b6a-42db-a3a4-adc7466d0682 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.866818 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19525678-8b6a-42db-a3a4-adc7466d0682 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.871053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.871936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.872216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.872488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] PATH_INFO: `/v3/projects/2ed61d0c0e074021bcb24ce527e9b064/users/0275401f5aa7461eaa1b1d72ad1dbe70/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.886105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed61d0c0e074021bcb24ce527e9b064, user_id=0275401f5aa7461eaa1b1d72ad1dbe70, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.888823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.900642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1238/2463] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:08:36 2021] PUT /identity/v3/projects/2ed61d0c0e074021bcb24ce527e9b064/users/0275401f5aa7461eaa1b1d72ad1dbe70/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:36.906160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f35a8-473e-4475-9728-844a8e9e910d None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.906479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f35a8-473e-4475-9728-844a8e9e910d None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.906762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f35a8-473e-4475-9728-844a8e9e910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.924383 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-d36f35a8-473e-4475-9728-844a8e9e910d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:36.925548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d36f35a8-473e-4475-9728-844a8e9e910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:36.981541 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1226/2464] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:08:36.992083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.993752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:37.048955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431fd2a-87ce-4cc3-9ed8-5fae2aac50c6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.052478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e3ee-617f-456d-8965-1b0ffe3a785f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.053124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e3ee-617f-456d-8965-1b0ffe3a785f service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.053413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e3ee-617f-456d-8965-1b0ffe3a785f service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.053689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e3ee-617f-456d-8965-1b0ffe3a785f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.062279 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765e3ee-617f-456d-8965-1b0ffe3a785f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.063700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765e3ee-617f-456d-8965-1b0ffe3a785f service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.072404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1239/2465] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:08:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:37.684302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d622c-9213-4bef-92fb-52d3de985cb4 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.684833 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d622c-9213-4bef-92fb-52d3de985cb4 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.685116 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d622c-9213-4bef-92fb-52d3de985cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.711820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a93d622c-9213-4bef-92fb-52d3de985cb4 None None] MFA Rules not processed for user `0275401f5aa7461eaa1b1d72ad1dbe70`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:37.712992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a93d622c-9213-4bef-92fb-52d3de985cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:37.776691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1227/2466] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:37 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:37.781625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e3ee-617f-456d-8965-1b0ffe3a785f service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:37.790804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e3ee-617f-456d-8965-1b0ffe3a785f service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.795112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d13e5-043a-41a7-afca-09b267ff707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.795984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d13e5-043a-41a7-afca-09b267ff707c admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.796433 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d13e5-043a-41a7-afca-09b267ff707c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.796986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d13e5-043a-41a7-afca-09b267ff707c admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.797994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d13e5-043a-41a7-afca-09b267ff707c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.799929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d13e5-043a-41a7-afca-09b267ff707c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.828634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1240/2467] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:08:37 2021] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:08:37.829754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d622c-9213-4bef-92fb-52d3de985cb4 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:37.839804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d622c-9213-4bef-92fb-52d3de985cb4 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.896648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd7705-ed82-494a-b656-84ef00eb0e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.897324 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7705-ed82-494a-b656-84ef00eb0e30 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.897605 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7705-ed82-494a-b656-84ef00eb0e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.897873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7705-ed82-494a-b656-84ef00eb0e30 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.898566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd7705-ed82-494a-b656-84ef00eb0e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.901624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd7705-ed82-494a-b656-84ef00eb0e30 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.923069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1228/2468] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:08:37 2021] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:08:37.927030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d13e5-043a-41a7-afca-09b267ff707c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:37.937543 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d13e5-043a-41a7-afca-09b267ff707c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.941851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575fd14-a013-451f-8719-c7dd23c81fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.942502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575fd14-a013-451f-8719-c7dd23c81fed admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.942783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575fd14-a013-451f-8719-c7dd23c81fed admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.943055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575fd14-a013-451f-8719-c7dd23c81fed admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.943800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575fd14-a013-451f-8719-c7dd23c81fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.945384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575fd14-a013-451f-8719-c7dd23c81fed admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.956480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1241/2469] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:08:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:08:37.960628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd7705-ed82-494a-b656-84ef00eb0e30 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:37.971035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd7705-ed82-494a-b656-84ef00eb0e30 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.975468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a805-6384-4918-a305-9291590fea0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.976397 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a805-6384-4918-a305-9291590fea0e admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.976682 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a805-6384-4918-a305-9291590fea0e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.976987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a805-6384-4918-a305-9291590fea0e admin admin] PATH_INFO: `/v3/projects/f35d66a6d37f416baa5923feee0ca176/users/4efde75f08b142b696162232cc231e24/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.992603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718a805-6384-4918-a305-9291590fea0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35d66a6d37f416baa5923feee0ca176, user_id=4efde75f08b142b696162232cc231e24, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.995255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718a805-6384-4918-a305-9291590fea0e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:38.008318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1229/2470] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:08:37 2021] PUT /identity/v3/projects/f35d66a6d37f416baa5923feee0ca176/users/4efde75f08b142b696162232cc231e24/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:38.012342 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575fd14-a013-451f-8719-c7dd23c81fed admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:38.021450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575fd14-a013-451f-8719-c7dd23c81fed admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:38.075048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862dbe0-f9c3-47bd-a9f9-0c2da4ef1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:38.075634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862dbe0-f9c3-47bd-a9f9-0c2da4ef1574 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:38.075945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862dbe0-f9c3-47bd-a9f9-0c2da4ef1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:38.076220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862dbe0-f9c3-47bd-a9f9-0c2da4ef1574 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:38.077116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862dbe0-f9c3-47bd-a9f9-0c2da4ef1574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:38.079087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862dbe0-f9c3-47bd-a9f9-0c2da4ef1574 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:38.088699 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1242/2471] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:08:38 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:08:38.092865 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a805-6384-4918-a305-9291590fea0e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:38.102194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a805-6384-4918-a305-9291590fea0e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:38.106851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:38.107756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:38.108035 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:38.108871 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] PATH_INFO: `/v3/projects/f35d66a6d37f416baa5923feee0ca176/users/4efde75f08b142b696162232cc231e24/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:38.110782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35d66a6d37f416baa5923feee0ca176, user_id=4efde75f08b142b696162232cc231e24, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:38.113473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:38.123350 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1230/2472] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:08:38 2021] PUT /identity/v3/projects/f35d66a6d37f416baa5923feee0ca176/users/4efde75f08b142b696162232cc231e24/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:08:38.742689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a97c6a-8212-4109-8cb1-52b821817f6d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:38.743056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a97c6a-8212-4109-8cb1-52b821817f6d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:38.743345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a97c6a-8212-4109-8cb1-52b821817f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:38.769527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-e2a97c6a-8212-4109-8cb1-52b821817f6d None None] MFA Rules not processed for user `4efde75f08b142b696162232cc231e24`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:38.770722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e2a97c6a-8212-4109-8cb1-52b821817f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:38.837238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1243/2473] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:08:38 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:38.850452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:38.852088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:38.907851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ab01a-0eb0-4628-9d74-8146384a9233 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:38.911485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:38.912159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:38.912441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:38.912711 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:38.970635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:38.972160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:38.981749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1231/2474] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:08:38 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:51.263999 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a97c6a-8212-4109-8cb1-52b821817f6d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:51.273184 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a97c6a-8212-4109-8cb1-52b821817f6d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:51.276574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:51.277213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:51.277494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:51.277766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:51.279452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:51.363816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:51.365250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:51.382782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1244/2475] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:08:51 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:43.685412 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.687392 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:43.698111 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe4a39-081a-4bf2-8f08-4dd5df73e7e3 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:43.701610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b59df-58da-4249-8236-c0cb80443201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:43.702882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b59df-58da-4249-8236-c0cb80443201 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.703161 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b59df-58da-4249-8236-c0cb80443201 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.703433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b59df-58da-4249-8236-c0cb80443201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.705139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d53b59df-58da-4249-8236-c0cb80443201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:43.780845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b59df-58da-4249-8236-c0cb80443201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:43.782272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b59df-58da-4249-8236-c0cb80443201 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:43.799486 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1232/2476] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:09:43 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:49.095027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:49.096501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:49.157221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a551b86-a144-4be1-ad5b-a202f12a9e3a service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:49.161519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:49.162383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.162661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.162934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] PATH_INFO: `/v3/users/3cb9295cda334fbbac03b3961098140e` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.164090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb9295cda334fbbac03b3961098140e)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:49.165994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:49.210082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb9295cda334fbbac03b3961098140e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.221615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb9295cda334fbbac03b3961098140e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.228331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb9295cda334fbbac03b3961098140e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.228992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb9295cda334fbbac03b3961098140e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.236954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb9295cda334fbbac03b3961098140e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.243428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1245/2477] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:10:49 2021] DELETE /identity/v3/users/3cb9295cda334fbbac03b3961098140e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:49.248198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e4db-5b4a-4827-b108-ec2b335fa4a8 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.248695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e4db-5b4a-4827-b108-ec2b335fa4a8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.248811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e4db-5b4a-4827-b108-ec2b335fa4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.274036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3f23e4db-5b4a-4827-b108-ec2b335fa4a8 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:49.275193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3f23e4db-5b4a-4827-b108-ec2b335fa4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:49.330552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1233/2478] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:10:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:10:49.341059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:49.342368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:49.396555 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f995ac2-9785-4efd-95ec-5b48393166ed admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:49.400052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf22fa-4f98-4a87-8322-db6287919d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:49.400691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf22fa-4f98-4a87-8322-db6287919d38 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.400975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf22fa-4f98-4a87-8322-db6287919d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.401250 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf22fa-4f98-4a87-8322-db6287919d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.410388 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf22fa-4f98-4a87-8322-db6287919d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:49.411853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf22fa-4f98-4a87-8322-db6287919d38 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:49.420587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1246/2479] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:10:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:49.695915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e4db-5b4a-4827-b108-ec2b335fa4a8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:49.697658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3f23e4db-5b4a-4827-b108-ec2b335fa4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:49.709322 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e4db-5b4a-4827-b108-ec2b335fa4a8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:49.713892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:49.714752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.715032 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.715310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] PATH_INFO: `/v3/projects/1702326da7164b51a0d5d6cbd7e4e277` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.717207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1702326da7164b51a0d5d6cbd7e4e277)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:49.718389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:49.765399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1702326da7164b51a0d5d6cbd7e4e277', 'request_id': 'req-b87301c8-693f-4222-9b00-47482d578373'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.772000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1702326da7164b51a0d5d6cbd7e4e277', 'request_id': 'req-b87301c8-693f-4222-9b00-47482d578373'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.779110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1702326da7164b51a0d5d6cbd7e4e277', 'request_id': 'req-b87301c8-693f-4222-9b00-47482d578373'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.790127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] The token cache is being invalidate because project 1702326da7164b51a0d5d6cbd7e4e277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:49.790408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.791100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-b87301c8-693f-4222-9b00-47482d578373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.792685 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1234/2480] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:10:49 2021] DELETE /identity/v3/projects/1702326da7164b51a0d5d6cbd7e4e277 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:49.804115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937dee-0a75-4190-9a38-4b61029695ce None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.804431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937dee-0a75-4190-9a38-4b61029695ce None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.804707 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937dee-0a75-4190-9a38-4b61029695ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.849974 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d6937dee-0a75-4190-9a38-4b61029695ce None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:49.851114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d6937dee-0a75-4190-9a38-4b61029695ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:49.906130 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1247/2481] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:10:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:49.914636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc937-8d0a-4152-8bf0-9659b2274b62 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.914925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc937-8d0a-4152-8bf0-9659b2274b62 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.915204 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc937-8d0a-4152-8bf0-9659b2274b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.932814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-af6dc937-8d0a-4152-8bf0-9659b2274b62 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:49.933970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-af6dc937-8d0a-4152-8bf0-9659b2274b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:49.941287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1235/2482] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:10:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:49.945206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937dee-0a75-4190-9a38-4b61029695ce None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:49.957471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937dee-0a75-4190-9a38-4b61029695ce None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:49.962023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:49.962680 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.962960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.963235 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.963992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:10:49.964299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:49.965894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:49.978021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1248/2483] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:10:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:10:49.982212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dc937-8d0a-4152-8bf0-9659b2274b62 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:49.990753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dc937-8d0a-4152-8bf0-9659b2274b62 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:49.995555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6dfa-9980-48ba-97b1-29bd52457ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:49.996301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6dfa-9980-48ba-97b1-29bd52457ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.996650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6dfa-9980-48ba-97b1-29bd52457ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.996998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6dfa-9980-48ba-97b1-29bd52457ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.997764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6dfa-9980-48ba-97b1-29bd52457ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:49.999745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6dfa-9980-48ba-97b1-29bd52457ca3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.035327 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1236/2484] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:10:49 2021] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:10:50.039349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.048722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74052de7-b129-41a2-af0c-bcb6b473dbf2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.102343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df0223-3304-4fc8-83b1-869c78cd9482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.102994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0223-3304-4fc8-83b1-869c78cd9482 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.103285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0223-3304-4fc8-83b1-869c78cd9482 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.103558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0223-3304-4fc8-83b1-869c78cd9482 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.104281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df0223-3304-4fc8-83b1-869c78cd9482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.106275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df0223-3304-4fc8-83b1-869c78cd9482 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.126625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1249/2485] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:10:50 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:10:50.130624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6dfa-9980-48ba-97b1-29bd52457ca3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.140112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6dfa-9980-48ba-97b1-29bd52457ca3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.145167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73042f4d-25be-4206-b0eb-a3d4ced11795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.145821 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73042f4d-25be-4206-b0eb-a3d4ced11795 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.146125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73042f4d-25be-4206-b0eb-a3d4ced11795 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.146398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73042f4d-25be-4206-b0eb-a3d4ced11795 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.147114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73042f4d-25be-4206-b0eb-a3d4ced11795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.148746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73042f4d-25be-4206-b0eb-a3d4ced11795 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.158462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1237/2486] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:10:50 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:50.162066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df0223-3304-4fc8-83b1-869c78cd9482 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.171356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df0223-3304-4fc8-83b1-869c78cd9482 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.175806 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71095cdf-30f1-4c1d-a6f7-0c0387245cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.176462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095cdf-30f1-4c1d-a6f7-0c0387245cef admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.176743 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095cdf-30f1-4c1d-a6f7-0c0387245cef admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.177021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095cdf-30f1-4c1d-a6f7-0c0387245cef admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.177737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71095cdf-30f1-4c1d-a6f7-0c0387245cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.179317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71095cdf-30f1-4c1d-a6f7-0c0387245cef admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.189463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1250/2487] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:10:50 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:50.193376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73042f4d-25be-4206-b0eb-a3d4ced11795 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.202492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73042f4d-25be-4206-b0eb-a3d4ced11795 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.207511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100065-6f17-49bf-90ea-2887d336bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.208414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100065-6f17-49bf-90ea-2887d336bd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.208694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100065-6f17-49bf-90ea-2887d336bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.208969 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100065-6f17-49bf-90ea-2887d336bd9c admin admin] PATH_INFO: `/v3/projects/9a1fbad201cb42968b987451ffe02c72/users/499c0b33a3164827b5cdf074ebde27eb/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.223080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22100065-6f17-49bf-90ea-2887d336bd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1fbad201cb42968b987451ffe02c72, user_id=499c0b33a3164827b5cdf074ebde27eb, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.225766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22100065-6f17-49bf-90ea-2887d336bd9c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.239260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1238/2488] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:10:50 2021] PUT /identity/v3/projects/9a1fbad201cb42968b987451ffe02c72/users/499c0b33a3164827b5cdf074ebde27eb/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:10:50.249312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0bf6b-66e0-418e-9ac3-ada2870fd543 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.249604 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0bf6b-66e0-418e-9ac3-ada2870fd543 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.249884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0bf6b-66e0-418e-9ac3-ada2870fd543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.276679 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5ba0bf6b-66e0-418e-9ac3-ada2870fd543 None None] MFA Rules not processed for user `499c0b33a3164827b5cdf074ebde27eb`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:50.277845 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5ba0bf6b-66e0-418e-9ac3-ada2870fd543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:50.338492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1251/2489] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:10:50 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:50.343543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100065-6f17-49bf-90ea-2887d336bd9c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.403657 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100065-6f17-49bf-90ea-2887d336bd9c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.408059 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083c59-d015-4fa2-aee3-d088fab41f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.409219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083c59-d015-4fa2-aee3-d088fab41f28 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.409497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083c59-d015-4fa2-aee3-d088fab41f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.409766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083c59-d015-4fa2-aee3-d088fab41f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.410447 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083c59-d015-4fa2-aee3-d088fab41f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.412361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083c59-d015-4fa2-aee3-d088fab41f28 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.436616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1239/2490] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:10:50 2021] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:10:50.441849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0bf6b-66e0-418e-9ac3-ada2870fd543 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.451887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0bf6b-66e0-418e-9ac3-ada2870fd543 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.509333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3369-06a2-41f5-8af8-c3b091c48078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.510006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3369-06a2-41f5-8af8-c3b091c48078 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.510284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3369-06a2-41f5-8af8-c3b091c48078 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.510553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3369-06a2-41f5-8af8-c3b091c48078 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.511227 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf3369-06a2-41f5-8af8-c3b091c48078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.513154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf3369-06a2-41f5-8af8-c3b091c48078 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.537577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1252/2491] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:10:50 2021] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:10:50.539260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083c59-d015-4fa2-aee3-d088fab41f28 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.549802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083c59-d015-4fa2-aee3-d088fab41f28 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.554302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430e939-7e3a-4376-b1e6-455775c1c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.555361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e939-7e3a-4376-b1e6-455775c1c54f admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.555650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e939-7e3a-4376-b1e6-455775c1c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.555965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e939-7e3a-4376-b1e6-455775c1c54f admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.556687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430e939-7e3a-4376-b1e6-455775c1c54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.558266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430e939-7e3a-4376-b1e6-455775c1c54f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.572964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1240/2492] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:10:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:50.574080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3369-06a2-41f5-8af8-c3b091c48078 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.583334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3369-06a2-41f5-8af8-c3b091c48078 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.587882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750859-82c9-4637-8c33-b07be4ec5e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.588794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750859-82c9-4637-8c33-b07be4ec5e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.589081 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750859-82c9-4637-8c33-b07be4ec5e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.589349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750859-82c9-4637-8c33-b07be4ec5e25 admin admin] PATH_INFO: `/v3/projects/d0580014d4f0415989d3ee3728f81716/users/f7666440ef3649809f4f568218a2ccd2/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.603693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750859-82c9-4637-8c33-b07be4ec5e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0580014d4f0415989d3ee3728f81716, user_id=f7666440ef3649809f4f568218a2ccd2, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.606608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750859-82c9-4637-8c33-b07be4ec5e25 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.619429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1253/2493] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:10:50 2021] PUT /identity/v3/projects/d0580014d4f0415989d3ee3728f81716/users/f7666440ef3649809f4f568218a2ccd2/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:10:50.623404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430e939-7e3a-4376-b1e6-455775c1c54f admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.633555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430e939-7e3a-4376-b1e6-455775c1c54f admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.685747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fed23-37f8-4061-a9f9-f4eba92bcf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.686399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fed23-37f8-4061-a9f9-f4eba92bcf97 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.686679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fed23-37f8-4061-a9f9-f4eba92bcf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.686951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fed23-37f8-4061-a9f9-f4eba92bcf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.687654 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fed23-37f8-4061-a9f9-f4eba92bcf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.689257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fed23-37f8-4061-a9f9-f4eba92bcf97 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.699598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1241/2494] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:10:50 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:50.703801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750859-82c9-4637-8c33-b07be4ec5e25 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.713846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750859-82c9-4637-8c33-b07be4ec5e25 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.718246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.719116 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.719397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.719670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] PATH_INFO: `/v3/projects/d0580014d4f0415989d3ee3728f81716/users/f7666440ef3649809f4f568218a2ccd2/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.722157 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0580014d4f0415989d3ee3728f81716, user_id=f7666440ef3649809f4f568218a2ccd2, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.724840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.734985 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1254/2495] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:10:50 2021] PUT /identity/v3/projects/d0580014d4f0415989d3ee3728f81716/users/f7666440ef3649809f4f568218a2ccd2/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:10:50.746951 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31f866-db14-4648-95d2-1d442d1a4ee6 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.747237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31f866-db14-4648-95d2-1d442d1a4ee6 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.747558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31f866-db14-4648-95d2-1d442d1a4ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.773260 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-df31f866-db14-4648-95d2-1d442d1a4ee6 None None] MFA Rules not processed for user `f7666440ef3649809f4f568218a2ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:50.774414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-df31f866-db14-4648-95d2-1d442d1a4ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:50.839468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1242/2496] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:10:50 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:50.850593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.852303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:50.906537 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58801237-0186-4771-9f83-8c9a8ab58161 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.910976 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.911643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.911960 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.912239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.920828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.922312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.931582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1255/2497] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:10:50 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:51.010549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31f866-db14-4648-95d2-1d442d1a4ee6 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:51.019967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31f866-db14-4648-95d2-1d442d1a4ee6 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:51.023691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:51.024354 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:51.024633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:51.024905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:51.081416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:51.082853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:51.097681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1243/2498] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:10:51 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:11:38.885472 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:11:38.886831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:38.907881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344834d-e8d3-4793-9bbc-612b65fb5aba service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:11:38.912073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:11:38.912714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:38.912998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:38.913273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:38.914962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:38.979989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:11:38.981440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:11:38.991568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1256/2499] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:11:38 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:11:39.086880 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:11:39.088493 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:39.187264 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4dcdb-fd4e-499a-8cf5-1f9c28eb9674 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:11:39.190845 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:11:39.191484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:39.191793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:39.192065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:39.193764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:39.204659 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: WARNING keystone.server.flask.application [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] Could not find project: bd48ecb22cb04b3293e7bf8efaa3e1c6.: keystone.exception.ProjectNotFound: Could not find project: bd48ecb22cb04b3293e7bf8efaa3e1c6. Jul 28 04:11:39.207769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1244/2500] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:11:39 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 28 04:11:53.901545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:11:53.902905 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:54.026245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b65129-ae3a-4040-b1cb-bdf243e13da9 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:11:54.031246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:11:54.031933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:54.032188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:54.032460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:54.034724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:54.045377 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:11:54.048935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:11:54.057188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1257/2501] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:11:53 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:11:59.444026 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:11:59.445477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:59.513727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f293a-6f82-4ba0-ba3c-c518c5d43f58 service glance] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:11:59.518210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:11:59.519064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:59.519346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:59.519623 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] PATH_INFO: `/v3/users/0275401f5aa7461eaa1b1d72ad1dbe70` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:59.520808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0275401f5aa7461eaa1b1d72ad1dbe70)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:11:59.522725 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:11:59.567570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0275401f5aa7461eaa1b1d72ad1dbe70'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.581197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0275401f5aa7461eaa1b1d72ad1dbe70'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.581888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0275401f5aa7461eaa1b1d72ad1dbe70'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.590574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0275401f5aa7461eaa1b1d72ad1dbe70'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.591281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0275401f5aa7461eaa1b1d72ad1dbe70'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.603680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1245/2502] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:11:59 2021] DELETE /identity/v3/users/0275401f5aa7461eaa1b1d72ad1dbe70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:11:59.780753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:11:59.793553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce029dd-b12f-49e2-8516-8f7f3a0f30a8 service placement] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:11:59.848894 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:11:59.849742 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:59.850017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:59.850286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] PATH_INFO: `/v3/projects/2ed61d0c0e074021bcb24ce527e9b064` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:59.851392 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed61d0c0e074021bcb24ce527e9b064)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:11:59.853320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:11:59.897054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed61d0c0e074021bcb24ce527e9b064', 'request_id': 'req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.902684 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed61d0c0e074021bcb24ce527e9b064', 'request_id': 'req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.910136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed61d0c0e074021bcb24ce527e9b064', 'request_id': 'req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.920343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] The token cache is being invalidate because project 2ed61d0c0e074021bcb24ce527e9b064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:11:59.921218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.921332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:11:59.922799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1258/2503] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:11:59 2021] DELETE /identity/v3/projects/2ed61d0c0e074021bcb24ce527e9b064 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:11:59.927312 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:11:59.928738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:59.940753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755485f-b30e-4d8d-9e0d-6656119ce491 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:11:59.995572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:11:59.996472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:59.996756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:59.997037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] PATH_INFO: `/v3/users/4efde75f08b142b696162232cc231e24` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:59.998186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4efde75f08b142b696162232cc231e24)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.000157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:00.047355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4efde75f08b142b696162232cc231e24'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.058979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4efde75f08b142b696162232cc231e24'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.059635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4efde75f08b142b696162232cc231e24'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.066800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4efde75f08b142b696162232cc231e24'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.067424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-840f6893-01ca-4529-ab2e-8c0a0dd0be03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4efde75f08b142b696162232cc231e24'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.079299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1246/2504] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:11:59 2021] DELETE /identity/v3/users/4efde75f08b142b696162232cc231e24 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:00.255739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:00.257334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:00.275693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9e1d3-02d1-4da9-8bc3-1a706ab0205b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:00.334927 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:00.335968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.336176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.336412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] PATH_INFO: `/v3/projects/f35d66a6d37f416baa5923feee0ca176` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.338144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35d66a6d37f416baa5923feee0ca176)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.340514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:00.384530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35d66a6d37f416baa5923feee0ca176', 'request_id': 'req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.390452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35d66a6d37f416baa5923feee0ca176', 'request_id': 'req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.397820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35d66a6d37f416baa5923feee0ca176', 'request_id': 'req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.407486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] The token cache is being invalidate because project f35d66a6d37f416baa5923feee0ca176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:00.407804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.409021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a4ad9844-cbc2-4fc8-a16d-f42bf781ce80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:00.410540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1259/2505] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:00 2021] DELETE /identity/v3/projects/f35d66a6d37f416baa5923feee0ca176 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:00.416250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7ddd-93f2-4551-a3d1-bb495780e90c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.416547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7ddd-93f2-4551-a3d1-bb495780e90c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.416830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7ddd-93f2-4551-a3d1-bb495780e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.433758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3b7d7ddd-93f2-4551-a3d1-bb495780e90c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:00.434834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3b7d7ddd-93f2-4551-a3d1-bb495780e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:00.491188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1247/2506] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:00.499036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7bd4-d41a-446e-865b-01e3be505c81 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.499329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7bd4-d41a-446e-865b-01e3be505c81 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.499609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7bd4-d41a-446e-865b-01e3be505c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.517726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-7c6a7bd4-d41a-446e-865b-01e3be505c81 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:00.518886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7c6a7bd4-d41a-446e-865b-01e3be505c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:00.526189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1260/2507] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:00.530202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d7ddd-93f2-4551-a3d1-bb495780e90c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:00.539596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d7ddd-93f2-4551-a3d1-bb495780e90c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:00.543998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:00.544646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.544927 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.545199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.545916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:12:00.546219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.547836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:00.559554 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1248/2508] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:12:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:12:00.563614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a7bd4-d41a-446e-865b-01e3be505c81 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:00.572223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a7bd4-d41a-446e-865b-01e3be505c81 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:00.576640 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da60af-0bf0-4792-9479-e420d51150b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:00.577284 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da60af-0bf0-4792-9479-e420d51150b8 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.577570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da60af-0bf0-4792-9479-e420d51150b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.577849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da60af-0bf0-4792-9479-e420d51150b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.578540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da60af-0bf0-4792-9479-e420d51150b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.580512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da60af-0bf0-4792-9479-e420d51150b8 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:00.608848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1261/2509] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:00 2021] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:12:00.609952 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:00.619773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1169e0-6271-48c6-862b-6e208f6b49f7 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:00.674879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003747-4b7c-4375-9f95-4ae48d868226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:00.675546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003747-4b7c-4375-9f95-4ae48d868226 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.675861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003747-4b7c-4375-9f95-4ae48d868226 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.676139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003747-4b7c-4375-9f95-4ae48d868226 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.676818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04003747-4b7c-4375-9f95-4ae48d868226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.678719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04003747-4b7c-4375-9f95-4ae48d868226 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:00.697282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1249/2510] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:00 2021] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:00.701230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da60af-0bf0-4792-9479-e420d51150b8 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:00.710779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da60af-0bf0-4792-9479-e420d51150b8 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:00.715491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163f87e-ecba-4b65-97af-7f4dfc338b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:00.716195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163f87e-ecba-4b65-97af-7f4dfc338b11 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.716478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163f87e-ecba-4b65-97af-7f4dfc338b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.716754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163f87e-ecba-4b65-97af-7f4dfc338b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.717481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163f87e-ecba-4b65-97af-7f4dfc338b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.719080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163f87e-ecba-4b65-97af-7f4dfc338b11 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:00.730757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1262/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:00.734828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003747-4b7c-4375-9f95-4ae48d868226 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:00.744960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003747-4b7c-4375-9f95-4ae48d868226 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:00.749217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54ba46-41cf-456f-a1e2-427b2fe7a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:00.749883 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54ba46-41cf-456f-a1e2-427b2fe7a190 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.750173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54ba46-41cf-456f-a1e2-427b2fe7a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.750443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54ba46-41cf-456f-a1e2-427b2fe7a190 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.751187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54ba46-41cf-456f-a1e2-427b2fe7a190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.752836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54ba46-41cf-456f-a1e2-427b2fe7a190 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:00.765916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1250/2512] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:00.767040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163f87e-ecba-4b65-97af-7f4dfc338b11 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:00.776788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163f87e-ecba-4b65-97af-7f4dfc338b11 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:00.781162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:00.782040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.782319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.782590 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] PATH_INFO: `/v3/projects/0a1c4f4120724f61888c6bb745b3887a/users/0e7ed1b4e97d4e62bb0a586b747e77e0/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.797771 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1c4f4120724f61888c6bb745b3887a, user_id=0e7ed1b4e97d4e62bb0a586b747e77e0, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.801466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:00.816280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1263/2513] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:00 2021] PUT /identity/v3/projects/0a1c4f4120724f61888c6bb745b3887a/users/0e7ed1b4e97d4e62bb0a586b747e77e0/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:00.826169 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de451-3023-4f2c-9651-988b210cec0b None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.826462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de451-3023-4f2c-9651-988b210cec0b None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.826743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de451-3023-4f2c-9651-988b210cec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.855434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f23de451-3023-4f2c-9651-988b210cec0b None None] MFA Rules not processed for user `0e7ed1b4e97d4e62bb0a586b747e77e0`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:00.857148 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f23de451-3023-4f2c-9651-988b210cec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:00.918731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1251/2514] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:00 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:00.929222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:00.930933 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:00.983988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2157a5-4ba7-49f2-89bb-c8a49614ad86 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:00.988115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77011a60-9e7d-4d2c-aee3-2cbc9ab16a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:00.988752 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011a60-9e7d-4d2c-aee3-2cbc9ab16a2a service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:00.989051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011a60-9e7d-4d2c-aee3-2cbc9ab16a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:00.989323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011a60-9e7d-4d2c-aee3-2cbc9ab16a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:00.997117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77011a60-9e7d-4d2c-aee3-2cbc9ab16a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:00.998541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77011a60-9e7d-4d2c-aee3-2cbc9ab16a2a service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:01.008170 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1264/2515] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:00 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:12.438272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23de451-3023-4f2c-9651-988b210cec0b None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:12.501098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23de451-3023-4f2c-9651-988b210cec0b None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:12.505495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:12.506356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:12.506637 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:12.506909 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] PATH_INFO: `/v3/users/0e7ed1b4e97d4e62bb0a586b747e77e0` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:12.508151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7ed1b4e97d4e62bb0a586b747e77e0)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:12.510092 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:12.554549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7ed1b4e97d4e62bb0a586b747e77e0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:12.565624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7ed1b4e97d4e62bb0a586b747e77e0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:12.566337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7ed1b4e97d4e62bb0a586b747e77e0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:12.572751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7ed1b4e97d4e62bb0a586b747e77e0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:12.573372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7ed1b4e97d4e62bb0a586b747e77e0'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:12.586213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1252/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:12 2021] DELETE /identity/v3/users/0e7ed1b4e97d4e62bb0a586b747e77e0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:12.590701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba724-b137-4083-9e3e-71f6daf62af1 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:12.591175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba724-b137-4083-9e3e-71f6daf62af1 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:12.591393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba724-b137-4083-9e3e-71f6daf62af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:12.608918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-a3bba724-b137-4083-9e3e-71f6daf62af1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:12.610084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a3bba724-b137-4083-9e3e-71f6daf62af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:12.676319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1265/2517] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:12.686181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:12.687621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:12.748690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804448c-0d1d-4c44-934b-45d82095a202 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:12.756137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247360-c0f5-4618-9655-9440513057c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:12.756137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247360-c0f5-4618-9655-9440513057c3 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:12.756137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247360-c0f5-4618-9655-9440513057c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:12.756137 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247360-c0f5-4618-9655-9440513057c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:12.764947 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32247360-c0f5-4618-9655-9440513057c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:12.766669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32247360-c0f5-4618-9655-9440513057c3 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:12.778858 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1253/2518] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:13.076028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba724-b137-4083-9e3e-71f6daf62af1 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.077499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a3bba724-b137-4083-9e3e-71f6daf62af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:13.094088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba724-b137-4083-9e3e-71f6daf62af1 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.099358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.100242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.100571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.100890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] PATH_INFO: `/v3/projects/0a1c4f4120724f61888c6bb745b3887a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.101966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1c4f4120724f61888c6bb745b3887a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.103902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.153072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1c4f4120724f61888c6bb745b3887a', 'request_id': 'req-7fb63f12-acd7-4754-b3d5-4d18fd89062a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:13.160327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1c4f4120724f61888c6bb745b3887a', 'request_id': 'req-7fb63f12-acd7-4754-b3d5-4d18fd89062a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:13.170553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1c4f4120724f61888c6bb745b3887a', 'request_id': 'req-7fb63f12-acd7-4754-b3d5-4d18fd89062a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:13.183248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] The token cache is being invalidate because project 0a1c4f4120724f61888c6bb745b3887a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:13.183591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:13.184255 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fb63f12-acd7-4754-b3d5-4d18fd89062a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:13.185792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1266/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:13 2021] DELETE /identity/v3/projects/0a1c4f4120724f61888c6bb745b3887a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:13.192358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9daa3-ed6f-4928-8312-08ffd53050f1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.192644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9daa3-ed6f-4928-8312-08ffd53050f1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.192919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9daa3-ed6f-4928-8312-08ffd53050f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.214363 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-fcf9daa3-ed6f-4928-8312-08ffd53050f1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:13.216061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fcf9daa3-ed6f-4928-8312-08ffd53050f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:13.276623 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1254/2520] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:13.284516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65621-a49a-421f-85d6-a982808dbb3d None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.285023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65621-a49a-421f-85d6-a982808dbb3d None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.285346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65621-a49a-421f-85d6-a982808dbb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.304362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2db65621-a49a-421f-85d6-a982808dbb3d None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:13.305532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2db65621-a49a-421f-85d6-a982808dbb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:13.312841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1267/2521] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:13.317815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9daa3-ed6f-4928-8312-08ffd53050f1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.326732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9daa3-ed6f-4928-8312-08ffd53050f1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.333077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.333735 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.334052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.334329 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.335049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:12:13.335353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.337047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.350098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1255/2522] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:12:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:12:13.354928 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65621-a49a-421f-85d6-a982808dbb3d None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.365440 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65621-a49a-421f-85d6-a982808dbb3d None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.369968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68e62f-043d-4568-afef-b17aa0754517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.370617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e62f-043d-4568-afef-b17aa0754517 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.370893 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e62f-043d-4568-afef-b17aa0754517 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.371165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68e62f-043d-4568-afef-b17aa0754517 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.371887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68e62f-043d-4568-afef-b17aa0754517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.373757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68e62f-043d-4568-afef-b17aa0754517 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.398691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1268/2523] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:13 2021] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:13.402787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.412480 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb540d0-c692-404e-a853-3118de96edaf admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.465912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb7fb7-9916-4892-b649-7553459fd0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.466569 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb7fb7-9916-4892-b649-7553459fd0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.466761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb7fb7-9916-4892-b649-7553459fd0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.467034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb7fb7-9916-4892-b649-7553459fd0b4 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.467736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb7fb7-9916-4892-b649-7553459fd0b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.469646 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb7fb7-9916-4892-b649-7553459fd0b4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.489171 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1256/2524] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:13 2021] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:13.493346 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68e62f-043d-4568-afef-b17aa0754517 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.503282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68e62f-043d-4568-afef-b17aa0754517 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.507629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fbe58-7dba-4cbb-ad99-56c12feb2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.508317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbe58-7dba-4cbb-ad99-56c12feb2304 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.508601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbe58-7dba-4cbb-ad99-56c12feb2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.508877 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbe58-7dba-4cbb-ad99-56c12feb2304 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.509588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fbe58-7dba-4cbb-ad99-56c12feb2304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.511179 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fbe58-7dba-4cbb-ad99-56c12feb2304 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.521775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1269/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:12:13.525446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb7fb7-9916-4892-b649-7553459fd0b4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.534983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb7fb7-9916-4892-b649-7553459fd0b4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.539330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea1387-4106-4612-92b0-75fecf38c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.540002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1387-4106-4612-92b0-75fecf38c035 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.540309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1387-4106-4612-92b0-75fecf38c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.540580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1387-4106-4612-92b0-75fecf38c035 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.541286 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea1387-4106-4612-92b0-75fecf38c035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.542879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea1387-4106-4612-92b0-75fecf38c035 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.553416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1257/2526] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:12:13.557218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fbe58-7dba-4cbb-ad99-56c12feb2304 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.567123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fbe58-7dba-4cbb-ad99-56c12feb2304 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.572878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fd3a4-7b4f-40b4-92b9-9885be43e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.573757 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd3a4-7b4f-40b4-92b9-9885be43e457 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.574034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd3a4-7b4f-40b4-92b9-9885be43e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.574304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd3a4-7b4f-40b4-92b9-9885be43e457 admin admin] PATH_INFO: `/v3/projects/38fb7aea2b864207a0c000233d09fbd5/users/f1357c1f13c64cea81718638c4173d60/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.590504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fd3a4-7b4f-40b4-92b9-9885be43e457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fb7aea2b864207a0c000233d09fbd5, user_id=f1357c1f13c64cea81718638c4173d60, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.593153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fd3a4-7b4f-40b4-92b9-9885be43e457 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.605129 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1270/2527] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:13 2021] PUT /identity/v3/projects/38fb7aea2b864207a0c000233d09fbd5/users/f1357c1f13c64cea81718638c4173d60/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:12:13.616603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb447c2d-fe7b-4c61-a90f-c8e9f3b0e5da None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.616926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb447c2d-fe7b-4c61-a90f-c8e9f3b0e5da None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.617206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb447c2d-fe7b-4c61-a90f-c8e9f3b0e5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.643250 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-eb447c2d-fe7b-4c61-a90f-c8e9f3b0e5da None None] MFA Rules not processed for user `f1357c1f13c64cea81718638c4173d60`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:13.644468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-eb447c2d-fe7b-4c61-a90f-c8e9f3b0e5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:13.705050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1258/2528] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:13 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:13.709512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fd3a4-7b4f-40b4-92b9-9885be43e457 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.766646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fd3a4-7b4f-40b4-92b9-9885be43e457 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.771185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4ce4d-5a8c-4ce9-9945-c297e01697b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.771860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ce4d-5a8c-4ce9-9945-c297e01697b2 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.772145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ce4d-5a8c-4ce9-9945-c297e01697b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.772420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ce4d-5a8c-4ce9-9945-c297e01697b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.773101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4ce4d-5a8c-4ce9-9945-c297e01697b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.774984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4ce4d-5a8c-4ce9-9945-c297e01697b2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.798231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1271/2529] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:13 2021] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:12:13.803223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb447c2d-fe7b-4c61-a90f-c8e9f3b0e5da None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.813152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb447c2d-fe7b-4c61-a90f-c8e9f3b0e5da None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.867011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.867674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.867990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.868270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.868964 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.870908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.894332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1259/2530] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:13 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:13.895599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4ce4d-5a8c-4ce9-9945-c297e01697b2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.895862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.897568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:13.907945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4ce4d-5a8c-4ce9-9945-c297e01697b2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.912901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512b3ab-53ee-44e9-bf50-2e96c8f02fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.913571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b3ab-53ee-44e9-bf50-2e96c8f02fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.913852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b3ab-53ee-44e9-bf50-2e96c8f02fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.914127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b3ab-53ee-44e9-bf50-2e96c8f02fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.914841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512b3ab-53ee-44e9-bf50-2e96c8f02fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.916489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512b3ab-53ee-44e9-bf50-2e96c8f02fb1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.931095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1272/2531] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:13.931954 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512b3ab-53ee-44e9-bf50-2e96c8f02fb1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.941715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512b3ab-53ee-44e9-bf50-2e96c8f02fb1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.946332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e4fe-6e27-419a-b8e9-8bc7659770ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.947223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e4fe-6e27-419a-b8e9-8bc7659770ec admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.947527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e4fe-6e27-419a-b8e9-8bc7659770ec admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.947824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e4fe-6e27-419a-b8e9-8bc7659770ec admin admin] PATH_INFO: `/v3/projects/f4ab7d5c635945118f829d60303795e3/users/4227b8cad9e440eaa5bd3e40f81765cb/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.958209 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd5242-e728-492f-bc57-2f07b0bc976b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:13.962373 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:13.963129 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:13.963494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9e4fe-6e27-419a-b8e9-8bc7659770ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ab7d5c635945118f829d60303795e3, user_id=4227b8cad9e440eaa5bd3e40f81765cb, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.963797 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:13.964179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:13.966275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9e4fe-6e27-419a-b8e9-8bc7659770ec admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.966649 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:13.982309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1273/2532] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:13 2021] PUT /identity/v3/projects/f4ab7d5c635945118f829d60303795e3/users/4227b8cad9e440eaa5bd3e40f81765cb/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:13.983346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:13.984931 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:13.987017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e4fe-6e27-419a-b8e9-8bc7659770ec admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:13.998543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1260/2533] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:12:14.061988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e4fe-6e27-419a-b8e9-8bc7659770ec admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:14.067796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f069d9b-041f-4edb-aafa-c8c9dc4a556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:14.068654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069d9b-041f-4edb-aafa-c8c9dc4a556a admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:14.069027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069d9b-041f-4edb-aafa-c8c9dc4a556a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:14.069378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069d9b-041f-4edb-aafa-c8c9dc4a556a admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:14.070254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f069d9b-041f-4edb-aafa-c8c9dc4a556a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:14.072199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f069d9b-041f-4edb-aafa-c8c9dc4a556a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:14.084281 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1274/2534] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:12:14.088636 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:14.099304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654e97b-0b73-453f-978f-aa7ddf417d09 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:14.104773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:14.105664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:14.105991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:14.106272 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] PATH_INFO: `/v3/projects/f4ab7d5c635945118f829d60303795e3/users/4227b8cad9e440eaa5bd3e40f81765cb/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:14.108419 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ab7d5c635945118f829d60303795e3, user_id=4227b8cad9e440eaa5bd3e40f81765cb, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:14.111128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:14.129497 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1261/2535] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:14 2021] PUT /identity/v3/projects/f4ab7d5c635945118f829d60303795e3/users/4227b8cad9e440eaa5bd3e40f81765cb/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:12:14.139822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34097cd8-af0c-46a4-ad1e-2658eb47fd15 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:14.140119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34097cd8-af0c-46a4-ad1e-2658eb47fd15 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:14.140404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34097cd8-af0c-46a4-ad1e-2658eb47fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:14.171972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-34097cd8-af0c-46a4-ad1e-2658eb47fd15 None None] MFA Rules not processed for user `4227b8cad9e440eaa5bd3e40f81765cb`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:14.173152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-34097cd8-af0c-46a4-ad1e-2658eb47fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:14.257363 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1275/2536] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:14 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:14.268067 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:14.270340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:14.339052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3cf49-ca9c-48af-8638-899eec2d7737 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:14.343851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5fb8-85fb-47d7-8e1b-a54b8544ba1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:14.344612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5fb8-85fb-47d7-8e1b-a54b8544ba1c service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:14.344995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5fb8-85fb-47d7-8e1b-a54b8544ba1c service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:14.345375 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5fb8-85fb-47d7-8e1b-a54b8544ba1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:14.410504 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5fb8-85fb-47d7-8e1b-a54b8544ba1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:14.412255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5fb8-85fb-47d7-8e1b-a54b8544ba1c service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:14.422343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1262/2537] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:14 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:14.533824 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34097cd8-af0c-46a4-ad1e-2658eb47fd15 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:14.536459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-34097cd8-af0c-46a4-ad1e-2658eb47fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:14.603799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34097cd8-af0c-46a4-ad1e-2658eb47fd15 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:14.608441 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:14.609299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:14.609573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:14.609838 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] PATH_INFO: `/v3/users/5d6d5c2460744df9ba96e3d336e4747a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:14.610980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6d5c2460744df9ba96e3d336e4747a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:14.613618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:14.680198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6d5c2460744df9ba96e3d336e4747a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:14.695368 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6d5c2460744df9ba96e3d336e4747a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:14.702156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6d5c2460744df9ba96e3d336e4747a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:14.703020 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6d5c2460744df9ba96e3d336e4747a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:14.713218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b182faa9-d6fb-4e69-8c65-d324c573214b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6d5c2460744df9ba96e3d336e4747a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:14.720551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1276/2538] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:14 2021] DELETE /identity/v3/users/5d6d5c2460744df9ba96e3d336e4747a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:14.907188 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5fb8-85fb-47d7-8e1b-a54b8544ba1c service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:14.918780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5fb8-85fb-47d7-8e1b-a54b8544ba1c service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:14.972408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:14.973247 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:14.973522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:14.973793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] PATH_INFO: `/v3/projects/55fad6251ff244ea9f24d160e444628f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:14.974912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fad6251ff244ea9f24d160e444628f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:14.976831 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:15.022219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fad6251ff244ea9f24d160e444628f', 'request_id': 'req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:15.028181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fad6251ff244ea9f24d160e444628f', 'request_id': 'req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:15.036139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fad6251ff244ea9f24d160e444628f', 'request_id': 'req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:15.048487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] The token cache is being invalidate because project 55fad6251ff244ea9f24d160e444628f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:15.048772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:15.049401 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-e9fe9dfd-1269-4bb5-aa99-5fdd33160d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:15.051048 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1263/2539] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:14 2021] DELETE /identity/v3/projects/55fad6251ff244ea9f24d160e444628f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:15.056643 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd560-c47e-4156-970a-569c6e860465 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.056934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd560-c47e-4156-970a-569c6e860465 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.057209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd560-c47e-4156-970a-569c6e860465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.073912 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-dd0bd560-c47e-4156-970a-569c6e860465 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:15.075113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-dd0bd560-c47e-4156-970a-569c6e860465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:15.134917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1277/2540] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:15.143934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e6aee-20be-4f88-8d3b-3d3cf55bbb37 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.144382 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e6aee-20be-4f88-8d3b-3d3cf55bbb37 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.144736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e6aee-20be-4f88-8d3b-3d3cf55bbb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.163426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e76e6aee-20be-4f88-8d3b-3d3cf55bbb37 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:15.164648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e76e6aee-20be-4f88-8d3b-3d3cf55bbb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:15.172142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1264/2541] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:15.176792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd560-c47e-4156-970a-569c6e860465 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:15.186414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd560-c47e-4156-970a-569c6e860465 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:15.191303 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:15.192087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.192391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.192786 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.193519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:12:15.193849 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:15.195641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:15.212088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1278/2542] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:12:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:12:15.213226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e6aee-20be-4f88-8d3b-3d3cf55bbb37 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:15.222993 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e6aee-20be-4f88-8d3b-3d3cf55bbb37 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:15.227733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aac20-c877-4eb6-8f61-48ddc1da9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:15.228424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aac20-c877-4eb6-8f61-48ddc1da9864 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.228729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aac20-c877-4eb6-8f61-48ddc1da9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.229080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aac20-c877-4eb6-8f61-48ddc1da9864 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.229778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aac20-c877-4eb6-8f61-48ddc1da9864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:15.231815 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aac20-c877-4eb6-8f61-48ddc1da9864 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:15.257279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1265/2543] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:15 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:15.261413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:15.271427 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399953d-461e-453e-a34e-6a8d4164ba86 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:15.325389 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a7ef1-b8ec-45e7-9915-23699fc6e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:15.326054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a7ef1-b8ec-45e7-9915-23699fc6e621 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.326340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a7ef1-b8ec-45e7-9915-23699fc6e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.326615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a7ef1-b8ec-45e7-9915-23699fc6e621 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.327307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a7ef1-b8ec-45e7-9915-23699fc6e621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:15.329247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a7ef1-b8ec-45e7-9915-23699fc6e621 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:15.349316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1279/2544] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:15 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:15.353366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aac20-c877-4eb6-8f61-48ddc1da9864 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:15.363923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aac20-c877-4eb6-8f61-48ddc1da9864 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:15.368404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021208-6a29-410b-bb12-bfda8302e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:15.369065 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021208-6a29-410b-bb12-bfda8302e111 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.369349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021208-6a29-410b-bb12-bfda8302e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.369627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021208-6a29-410b-bb12-bfda8302e111 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.370346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40021208-6a29-410b-bb12-bfda8302e111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:15.371997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40021208-6a29-410b-bb12-bfda8302e111 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:15.383096 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1266/2545] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:12:15.387080 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a7ef1-b8ec-45e7-9915-23699fc6e621 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:15.397113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a7ef1-b8ec-45e7-9915-23699fc6e621 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:15.402421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0a91c-85e6-4aa3-8e83-0bf14ed4a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:15.403562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a91c-85e6-4aa3-8e83-0bf14ed4a3aa admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.403892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a91c-85e6-4aa3-8e83-0bf14ed4a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.404169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a91c-85e6-4aa3-8e83-0bf14ed4a3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.405064 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0a91c-85e6-4aa3-8e83-0bf14ed4a3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:15.406651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0a91c-85e6-4aa3-8e83-0bf14ed4a3aa admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:15.416507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1280/2546] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:15.420607 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021208-6a29-410b-bb12-bfda8302e111 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:15.430196 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021208-6a29-410b-bb12-bfda8302e111 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:15.438684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:15.439553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.439873 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.440150 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] PATH_INFO: `/v3/projects/699932c5162645f89bbd9d95710d863b/users/21290886e90f45f582840b785d64cd43/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.454939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699932c5162645f89bbd9d95710d863b, user_id=21290886e90f45f582840b785d64cd43, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:15.458284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:15.473091 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1267/2547] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:15 2021] PUT /identity/v3/projects/699932c5162645f89bbd9d95710d863b/users/21290886e90f45f582840b785d64cd43/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:15.478136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5640251-b239-4051-bb7a-488fe7addc97 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.478499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5640251-b239-4051-bb7a-488fe7addc97 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.478852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5640251-b239-4051-bb7a-488fe7addc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.497252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d5640251-b239-4051-bb7a-488fe7addc97 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:15.498436 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d5640251-b239-4051-bb7a-488fe7addc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:15.555189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1281/2548] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:15.565703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:15.567500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:15.623917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef78c1-8aba-4412-97c5-9717e5f9ef64 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:15.627527 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a30eb-7e1c-4a67-8336-941b87c5a8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:15.629024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a30eb-7e1c-4a67-8336-941b87c5a8da service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:15.629317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a30eb-7e1c-4a67-8336-941b87c5a8da service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:15.629596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a30eb-7e1c-4a67-8336-941b87c5a8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:15.638441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a30eb-7e1c-4a67-8336-941b87c5a8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:15.639860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a30eb-7e1c-4a67-8336-941b87c5a8da service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:15.652058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1268/2549] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:12:17.066413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5640251-b239-4051-bb7a-488fe7addc97 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:17.068622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d5640251-b239-4051-bb7a-488fe7addc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:17.112026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5640251-b239-4051-bb7a-488fe7addc97 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:17.145748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:17.146646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:17.147030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:17.147180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] PATH_INFO: `/v3/users/f1357c1f13c64cea81718638c4173d60` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:17.150181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1357c1f13c64cea81718638c4173d60)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:17.152176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:17.238685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1357c1f13c64cea81718638c4173d60'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:17.253362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1357c1f13c64cea81718638c4173d60'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:17.262146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1357c1f13c64cea81718638c4173d60'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:17.262934 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1357c1f13c64cea81718638c4173d60'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:17.274103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1357c1f13c64cea81718638c4173d60'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:17.282840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1282/2550] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:17 2021] DELETE /identity/v3/users/f1357c1f13c64cea81718638c4173d60 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:17.288151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c58ab-c7d6-40f0-bb0d-4026afbf273e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:17.289158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c58ab-c7d6-40f0-bb0d-4026afbf273e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:17.289421 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c58ab-c7d6-40f0-bb0d-4026afbf273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:17.323080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-a36c58ab-c7d6-40f0-bb0d-4026afbf273e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:17.324421 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a36c58ab-c7d6-40f0-bb0d-4026afbf273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:17.403009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1269/2551] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:17.422603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:17.424150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:17.488597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523977ae-dbe8-4809-90ba-6728a6c1dee2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:17.492909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0fa57-6beb-4ebb-9224-bc734b8f3731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:17.493560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0fa57-6beb-4ebb-9224-bc734b8f3731 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:17.493836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0fa57-6beb-4ebb-9224-bc734b8f3731 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:17.494105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0fa57-6beb-4ebb-9224-bc734b8f3731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:17.505854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0fa57-6beb-4ebb-9224-bc734b8f3731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:17.507439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0fa57-6beb-4ebb-9224-bc734b8f3731 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:17.517661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1283/2552] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:18.041974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c58ab-c7d6-40f0-bb0d-4026afbf273e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:18.043361 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a36c58ab-c7d6-40f0-bb0d-4026afbf273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:18.062064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c58ab-c7d6-40f0-bb0d-4026afbf273e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:18.067426 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:18.068330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:18.068629 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:18.069094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] PATH_INFO: `/v3/projects/38fb7aea2b864207a0c000233d09fbd5` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:18.070259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fb7aea2b864207a0c000233d09fbd5)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:18.072299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:18.131495 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fb7aea2b864207a0c000233d09fbd5', 'request_id': 'req-a102eee1-3fb3-4824-b334-cbb2dc4bf729'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.138031 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fb7aea2b864207a0c000233d09fbd5', 'request_id': 'req-a102eee1-3fb3-4824-b334-cbb2dc4bf729'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.146325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fb7aea2b864207a0c000233d09fbd5', 'request_id': 'req-a102eee1-3fb3-4824-b334-cbb2dc4bf729'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.156731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] The token cache is being invalidate because project 38fb7aea2b864207a0c000233d09fbd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:18.157094 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.157798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.159881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1270/2553] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:18 2021] DELETE /identity/v3/projects/38fb7aea2b864207a0c000233d09fbd5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:18.169220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0fa57-6beb-4ebb-9224-bc734b8f3731 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:18.185850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0fa57-6beb-4ebb-9224-bc734b8f3731 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:18.267040 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:18.269310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:18.269620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:18.269783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] PATH_INFO: `/v3/users/4227b8cad9e440eaa5bd3e40f81765cb` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:18.276650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4227b8cad9e440eaa5bd3e40f81765cb)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:18.278826 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:18.347736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4227b8cad9e440eaa5bd3e40f81765cb'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.372364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4227b8cad9e440eaa5bd3e40f81765cb'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.403162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4227b8cad9e440eaa5bd3e40f81765cb'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.404290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4227b8cad9e440eaa5bd3e40f81765cb'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.414003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e808976c-397a-46b7-aeac-29dc7e115c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4227b8cad9e440eaa5bd3e40f81765cb'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.422308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1284/2554] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:18 2021] DELETE /identity/v3/users/4227b8cad9e440eaa5bd3e40f81765cb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:18.804820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:18.806273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:18.830038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102eee1-3fb3-4824-b334-cbb2dc4bf729 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:18.915206 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:18.916127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:18.916652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:18.916652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] PATH_INFO: `/v3/projects/f4ab7d5c635945118f829d60303795e3` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:18.920737 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ab7d5c635945118f829d60303795e3)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:18.922726 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:18.978479 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ab7d5c635945118f829d60303795e3', 'request_id': 'req-10ccd1bb-4069-4225-a413-b2790930495b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:18.989816 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ab7d5c635945118f829d60303795e3', 'request_id': 'req-10ccd1bb-4069-4225-a413-b2790930495b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:19.002230 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ab7d5c635945118f829d60303795e3', 'request_id': 'req-10ccd1bb-4069-4225-a413-b2790930495b'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:19.019908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] The token cache is being invalidate because project f4ab7d5c635945118f829d60303795e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:19.020429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:19.021273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-10ccd1bb-4069-4225-a413-b2790930495b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:19.024332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1271/2555] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:18 2021] DELETE /identity/v3/projects/f4ab7d5c635945118f829d60303795e3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:19.029083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61030e-aa2c-4a8a-ace3-cf2b90494b62 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.029575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61030e-aa2c-4a8a-ace3-cf2b90494b62 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.030052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61030e-aa2c-4a8a-ace3-cf2b90494b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.051519 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ea61030e-aa2c-4a8a-ace3-cf2b90494b62 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:19.052769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ea61030e-aa2c-4a8a-ace3-cf2b90494b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:19.129925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1285/2556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:19.132592 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0fa5-7501-4b27-95ad-1de8825860ed None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.132882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0fa5-7501-4b27-95ad-1de8825860ed None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.134126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0fa5-7501-4b27-95ad-1de8825860ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.158114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-bb9e0fa5-7501-4b27-95ad-1de8825860ed None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:19.160219 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bb9e0fa5-7501-4b27-95ad-1de8825860ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:19.174210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1272/2557] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:19.179799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61030e-aa2c-4a8a-ace3-cf2b90494b62 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:19.189842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61030e-aa2c-4a8a-ace3-cf2b90494b62 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:19.195813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:19.196646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.197124 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.197787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.198442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:12:19.199403 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:19.201104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:19.214293 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1286/2558] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:12:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:12:19.218616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e0fa5-7501-4b27-95ad-1de8825860ed None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:19.228427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e0fa5-7501-4b27-95ad-1de8825860ed None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:19.233758 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07dc07-051b-49af-aa7a-43a7a00309ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:19.234496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07dc07-051b-49af-aa7a-43a7a00309ff admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.234785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07dc07-051b-49af-aa7a-43a7a00309ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.235174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07dc07-051b-49af-aa7a-43a7a00309ff admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.235988 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07dc07-051b-49af-aa7a-43a7a00309ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:19.238733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07dc07-051b-49af-aa7a-43a7a00309ff admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:19.277176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1273/2559] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:19 2021] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:19.281658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:19.293367 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4618ef-e4e3-4c0f-b7cc-6916ed1037da admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:19.369578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21179d9-4c6f-4bf1-9829-d2e4ac4729a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:19.370526 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21179d9-4c6f-4bf1-9829-d2e4ac4729a4 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.370858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21179d9-4c6f-4bf1-9829-d2e4ac4729a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.372212 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21179d9-4c6f-4bf1-9829-d2e4ac4729a4 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.373069 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21179d9-4c6f-4bf1-9829-d2e4ac4729a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:19.375340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21179d9-4c6f-4bf1-9829-d2e4ac4729a4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:19.411995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07dc07-051b-49af-aa7a-43a7a00309ff admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:19.423937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1287/2560] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:19 2021] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:19.431979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07dc07-051b-49af-aa7a-43a7a00309ff admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:19.437194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36365c2d-6dfa-4d45-be5a-5e70c686be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:19.438108 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365c2d-6dfa-4d45-be5a-5e70c686be4d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.438568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365c2d-6dfa-4d45-be5a-5e70c686be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.438991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365c2d-6dfa-4d45-be5a-5e70c686be4d admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.441928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36365c2d-6dfa-4d45-be5a-5e70c686be4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:19.443961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36365c2d-6dfa-4d45-be5a-5e70c686be4d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:19.468004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1274/2561] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:19 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:19.469419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21179d9-4c6f-4bf1-9829-d2e4ac4729a4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:19.483209 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21179d9-4c6f-4bf1-9829-d2e4ac4729a4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:19.492066 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776939ba-0da1-43c3-8e7f-952a62c60cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:19.492808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776939ba-0da1-43c3-8e7f-952a62c60cec admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.493280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776939ba-0da1-43c3-8e7f-952a62c60cec admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.493744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776939ba-0da1-43c3-8e7f-952a62c60cec admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.494683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776939ba-0da1-43c3-8e7f-952a62c60cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:19.496340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776939ba-0da1-43c3-8e7f-952a62c60cec admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:19.513580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1288/2562] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:19 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:19.514141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36365c2d-6dfa-4d45-be5a-5e70c686be4d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:19.525553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36365c2d-6dfa-4d45-be5a-5e70c686be4d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:19.530849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:19.532072 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.532563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.533066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] PATH_INFO: `/v3/projects/2a7e525a55fd498fa09a2ca59115a1dc/users/9d593c944bfc4a2c970fce753aac50f2/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.558052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7e525a55fd498fa09a2ca59115a1dc, user_id=9d593c944bfc4a2c970fce753aac50f2, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:19.562010 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:19.597719 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1275/2563] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:19 2021] PUT /identity/v3/projects/2a7e525a55fd498fa09a2ca59115a1dc/users/9d593c944bfc4a2c970fce753aac50f2/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:19.598720 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78cdd-dbbc-4670-9bc2-8a1d6675ee2f None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.599019 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78cdd-dbbc-4670-9bc2-8a1d6675ee2f None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.599353 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78cdd-dbbc-4670-9bc2-8a1d6675ee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.647557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-30e78cdd-dbbc-4670-9bc2-8a1d6675ee2f None None] MFA Rules not processed for user `9d593c944bfc4a2c970fce753aac50f2`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:19.649463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-30e78cdd-dbbc-4670-9bc2-8a1d6675ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:19.732216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1289/2564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:19 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:19.745611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:19.747577 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:19.813304 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66048cb0-fb49-47f6-a395-f2a8376f9f36 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:19.817446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:19.818101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:19.818382 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:19.818658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:19.828217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:19.829669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:19.839991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1276/2565] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:19 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:20.253665 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95d821-1418-4884-952d-89d63ef5f005 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:20.254191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95d821-1418-4884-952d-89d63ef5f005 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:20.254295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95d821-1418-4884-952d-89d63ef5f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:20.289804 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2f95d821-1418-4884-952d-89d63ef5f005 None None] MFA Rules not processed for user `21290886e90f45f582840b785d64cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:20.291205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2f95d821-1418-4884-952d-89d63ef5f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:20.405477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1290/2566] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:20 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:20.413866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:20.415432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:20.499209 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b80d9-40e5-46d8-9a35-0703c247e234 service glance] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:20.504487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb63b70-9989-429c-9be5-b2fd2778ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:20.505175 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb63b70-9989-429c-9be5-b2fd2778ef4d admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:20.505489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb63b70-9989-429c-9be5-b2fd2778ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:20.505790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb63b70-9989-429c-9be5-b2fd2778ef4d admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:20.506491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb63b70-9989-429c-9be5-b2fd2778ef4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:20.508468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb63b70-9989-429c-9be5-b2fd2778ef4d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:20.534925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1277/2567] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:20 2021] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:12:20.539292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95d821-1418-4884-952d-89d63ef5f005 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:20.550495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95d821-1418-4884-952d-89d63ef5f005 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:20.607614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013646e3-8d1b-43b0-ace2-141a3b60d62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:20.608338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013646e3-8d1b-43b0-ace2-141a3b60d62d admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:20.608620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013646e3-8d1b-43b0-ace2-141a3b60d62d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:20.608892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013646e3-8d1b-43b0-ace2-141a3b60d62d admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:20.609617 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013646e3-8d1b-43b0-ace2-141a3b60d62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:20.611591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013646e3-8d1b-43b0-ace2-141a3b60d62d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:20.632322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1291/2568] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:20 2021] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:20.636283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb63b70-9989-429c-9be5-b2fd2778ef4d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:20.646499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb63b70-9989-429c-9be5-b2fd2778ef4d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:20.650863 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1aec8-578c-426a-9086-ce07c1c4dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:20.651520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1aec8-578c-426a-9086-ce07c1c4dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:20.651884 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1aec8-578c-426a-9086-ce07c1c4dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:20.652158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1aec8-578c-426a-9086-ce07c1c4dc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:20.652867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1aec8-578c-426a-9086-ce07c1c4dc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:20.654458 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1aec8-578c-426a-9086-ce07c1c4dc31 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:20.666574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1278/2569] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:20.670805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013646e3-8d1b-43b0-ace2-141a3b60d62d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:20.695311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013646e3-8d1b-43b0-ace2-141a3b60d62d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:20.708028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fa9b6-6bf7-48cd-9a4c-67905e6bf606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:20.708955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa9b6-6bf7-48cd-9a4c-67905e6bf606 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:20.709239 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa9b6-6bf7-48cd-9a4c-67905e6bf606 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:20.709520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa9b6-6bf7-48cd-9a4c-67905e6bf606 admin admin] PATH_INFO: `/v3/projects/d2c2d70ab9114a06818ee7f77b1040d6/users/2b6b9711ab5345638cf5a6977b55bb37/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:20.725286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fa9b6-6bf7-48cd-9a4c-67905e6bf606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2d70ab9114a06818ee7f77b1040d6, user_id=2b6b9711ab5345638cf5a6977b55bb37, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:20.728031 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fa9b6-6bf7-48cd-9a4c-67905e6bf606 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:20.741882 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1292/2570] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:20 2021] PUT /identity/v3/projects/d2c2d70ab9114a06818ee7f77b1040d6/users/2b6b9711ab5345638cf5a6977b55bb37/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:20.745930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1aec8-578c-426a-9086-ce07c1c4dc31 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:20.756539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1aec8-578c-426a-9086-ce07c1c4dc31 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:20.813308 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f0270-3f17-4208-9cc2-a328d683c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:20.814038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0270-3f17-4208-9cc2-a328d683c300 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:20.814325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0270-3f17-4208-9cc2-a328d683c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:20.814611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0270-3f17-4208-9cc2-a328d683c300 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:20.816045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f0270-3f17-4208-9cc2-a328d683c300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:20.817638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f0270-3f17-4208-9cc2-a328d683c300 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:20.827555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1279/2571] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:20 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:12:20.832296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fa9b6-6bf7-48cd-9a4c-67905e6bf606 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:20.842127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fa9b6-6bf7-48cd-9a4c-67905e6bf606 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:20.846835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:20.847739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:20.848037 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:20.848317 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] PATH_INFO: `/v3/projects/d2c2d70ab9114a06818ee7f77b1040d6/users/2b6b9711ab5345638cf5a6977b55bb37/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:20.850185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2d70ab9114a06818ee7f77b1040d6, user_id=2b6b9711ab5345638cf5a6977b55bb37, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:20.852861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:20.864119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1293/2572] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:20 2021] PUT /identity/v3/projects/d2c2d70ab9114a06818ee7f77b1040d6/users/2b6b9711ab5345638cf5a6977b55bb37/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:26.023172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd01fc-12b5-4890-9877-c737ed66f62e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:26.024270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd01fc-12b5-4890-9877-c737ed66f62e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:26.024762 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd01fc-12b5-4890-9877-c737ed66f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:26.060788 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-47dd01fc-12b5-4890-9877-c737ed66f62e None None] MFA Rules not processed for user `2b6b9711ab5345638cf5a6977b55bb37`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:26.062135 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-47dd01fc-12b5-4890-9877-c737ed66f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:26.148554 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1280/2573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:26 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:26.161744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:26.163461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:26.181263 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd01fc-12b5-4890-9877-c737ed66f62e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:26.182743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-47dd01fc-12b5-4890-9877-c737ed66f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:26.260774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd01fc-12b5-4890-9877-c737ed66f62e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:26.266114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:26.267008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:26.267297 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:26.267574 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] PATH_INFO: `/v3/users/499c0b33a3164827b5cdf074ebde27eb` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:26.269611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499c0b33a3164827b5cdf074ebde27eb)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:26.271579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:26.277494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b073b-8d25-4144-b8c1-45baf488cb73 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:26.283329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2737f-c295-4adf-8a8f-b6368d113c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:26.283577 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2737f-c295-4adf-8a8f-b6368d113c22 service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:26.284701 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2737f-c295-4adf-8a8f-b6368d113c22 service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:26.285148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2737f-c295-4adf-8a8f-b6368d113c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:26.329856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499c0b33a3164827b5cdf074ebde27eb'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:26.342408 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499c0b33a3164827b5cdf074ebde27eb'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:26.343158 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499c0b33a3164827b5cdf074ebde27eb'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:26.345918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2737f-c295-4adf-8a8f-b6368d113c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:26.348243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2737f-c295-4adf-8a8f-b6368d113c22 service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:26.351142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499c0b33a3164827b5cdf074ebde27eb'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:26.351870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499c0b33a3164827b5cdf074ebde27eb'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:26.356825 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1294/2574] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:26 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:26.364681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1281/2575] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:26 2021] DELETE /identity/v3/users/499c0b33a3164827b5cdf074ebde27eb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:12:26.369350 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251371a-1584-476c-92c9-0202c6c5e7ee None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:26.369646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251371a-1584-476c-92c9-0202c6c5e7ee None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:26.369929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251371a-1584-476c-92c9-0202c6c5e7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:26.386185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5251371a-1584-476c-92c9-0202c6c5e7ee None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:26.387352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5251371a-1584-476c-92c9-0202c6c5e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:26.445935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1295/2576] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:26.456957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:26.458376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:26.521378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6af7c4-3795-483e-93bd-8a09ec554e85 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:26.525198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875c1f8-c5ce-4ab0-9af0-58cd001bb3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:26.525926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875c1f8-c5ce-4ab0-9af0-58cd001bb3ef service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:26.526294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875c1f8-c5ce-4ab0-9af0-58cd001bb3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:26.526633 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875c1f8-c5ce-4ab0-9af0-58cd001bb3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:26.536924 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875c1f8-c5ce-4ab0-9af0-58cd001bb3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:26.538376 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875c1f8-c5ce-4ab0-9af0-58cd001bb3ef service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:26.549925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1282/2577] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:27.061523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251371a-1584-476c-92c9-0202c6c5e7ee None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:27.062907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5251371a-1584-476c-92c9-0202c6c5e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:27.077153 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251371a-1584-476c-92c9-0202c6c5e7ee None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:27.082119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:27.082987 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:27.083267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:27.083540 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] PATH_INFO: `/v3/projects/9a1fbad201cb42968b987451ffe02c72` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:27.084993 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1fbad201cb42968b987451ffe02c72)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:27.087051 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:27.184062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1fbad201cb42968b987451ffe02c72', 'request_id': 'req-36949a6a-9328-42c4-88fa-8f9a546b2c9e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.196831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1fbad201cb42968b987451ffe02c72', 'request_id': 'req-36949a6a-9328-42c4-88fa-8f9a546b2c9e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.206729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1fbad201cb42968b987451ffe02c72', 'request_id': 'req-36949a6a-9328-42c4-88fa-8f9a546b2c9e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.229616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] The token cache is being invalidate because project 9a1fbad201cb42968b987451ffe02c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:27.229861 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.230740 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.232662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1296/2578] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:27 2021] DELETE /identity/v3/projects/9a1fbad201cb42968b987451ffe02c72 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:27.237792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875c1f8-c5ce-4ab0-9af0-58cd001bb3ef service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:27.252126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875c1f8-c5ce-4ab0-9af0-58cd001bb3ef service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:27.324391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:27.325434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:27.325767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:27.326311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] PATH_INFO: `/v3/users/f7666440ef3649809f4f568218a2ccd2` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:27.328200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7666440ef3649809f4f568218a2ccd2)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:27.330498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:27.405773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7666440ef3649809f4f568218a2ccd2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.423904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7666440ef3649809f4f568218a2ccd2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.424996 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7666440ef3649809f4f568218a2ccd2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.436313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7666440ef3649809f4f568218a2ccd2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.437829 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7666440ef3649809f4f568218a2ccd2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:27.459321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1283/2579] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:27 2021] DELETE /identity/v3/users/f7666440ef3649809f4f568218a2ccd2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:27.881943 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:27.883356 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:27.912780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36949a6a-9328-42c4-88fa-8f9a546b2c9e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:27.979044 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:27.980673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:27.991641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:27.992984 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:27.993360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:27.993735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] PATH_INFO: `/v3/projects/d0580014d4f0415989d3ee3728f81716` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:27.995142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0580014d4f0415989d3ee3728f81716)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:27.997758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.064755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0580014d4f0415989d3ee3728f81716', 'request_id': 'req-a6cf30d6-09bd-4e01-a062-2a831633b248'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:28.074891 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0580014d4f0415989d3ee3728f81716', 'request_id': 'req-a6cf30d6-09bd-4e01-a062-2a831633b248'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:28.077673 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c459e8-6e82-41d1-baa9-68479637fe62 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:28.087516 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0580014d4f0415989d3ee3728f81716', 'request_id': 'req-a6cf30d6-09bd-4e01-a062-2a831633b248'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:28.102274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] The token cache is being invalidate because project d0580014d4f0415989d3ee3728f81716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:28.103027 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:28.103884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-a6cf30d6-09bd-4e01-a062-2a831633b248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:28.106601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1297/2580] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:27 2021] DELETE /identity/v3/projects/d0580014d4f0415989d3ee3728f81716 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:28.112632 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a41fb0-4b3d-43e1-bcc7-fdcdd169566b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.113387 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a41fb0-4b3d-43e1-bcc7-fdcdd169566b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.113766 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a41fb0-4b3d-43e1-bcc7-fdcdd169566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.140446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:28.141159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.141451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.142054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.142715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-51a41fb0-4b3d-43e1-bcc7-fdcdd169566b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:28.144082 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-51a41fb0-4b3d-43e1-bcc7-fdcdd169566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:28.150822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:28.228275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1298/2581] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:28.236822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6495-87f1-47fc-9000-5ff52e7a8d36 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.237983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6495-87f1-47fc-9000-5ff52e7a8d36 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.239187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6495-87f1-47fc-9000-5ff52e7a8d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.259998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-25dc6495-87f1-47fc-9000-5ff52e7a8d36 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:28.261558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-25dc6495-87f1-47fc-9000-5ff52e7a8d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:28.270688 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:28.271611 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1299/2582] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:28.275606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.277002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc6495-87f1-47fc-9000-5ff52e7a8d36 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:28.291700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc6495-87f1-47fc-9000-5ff52e7a8d36 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:28.297307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:28.298123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.298946 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.299359 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.301309 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:12:28.301995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:28.304381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1284/2583] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:27 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:12:28.304868 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.337342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:28.339264 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1300/2584] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:12:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:12:28.358692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaff5-01cd-4eea-bc79-081e5df5c562 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:28.360224 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c27cc-549c-4c75-9c0d-bf7be4769671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:28.360946 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c27cc-549c-4c75-9c0d-bf7be4769671 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.361240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c27cc-549c-4c75-9c0d-bf7be4769671 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.361523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c27cc-549c-4c75-9c0d-bf7be4769671 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.362325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c27cc-549c-4c75-9c0d-bf7be4769671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:28.364551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c27cc-549c-4c75-9c0d-bf7be4769671 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.400288 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1285/2585] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:28 2021] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:12:28.402736 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:28.417414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6df3-f2ee-44a2-806a-84b491732756 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:28.486635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200fce4-b475-4cfc-8127-b1adb2773d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:28.487659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fce4-b475-4cfc-8127-b1adb2773d6d admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.487996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fce4-b475-4cfc-8127-b1adb2773d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.488290 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fce4-b475-4cfc-8127-b1adb2773d6d admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.489003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200fce4-b475-4cfc-8127-b1adb2773d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:28.491135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200fce4-b475-4cfc-8127-b1adb2773d6d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.522706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1301/2586] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:28 2021] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:12:28.526760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c27cc-549c-4c75-9c0d-bf7be4769671 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:28.538662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c27cc-549c-4c75-9c0d-bf7be4769671 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:28.545519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440be1-918f-4049-93cf-f670c68e18f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:28.546393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440be1-918f-4049-93cf-f670c68e18f3 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.546999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440be1-918f-4049-93cf-f670c68e18f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.547414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440be1-918f-4049-93cf-f670c68e18f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.548397 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2440be1-918f-4049-93cf-f670c68e18f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:28.562159 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2440be1-918f-4049-93cf-f670c68e18f3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.598200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1286/2587] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:28 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:28.601828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200fce4-b475-4cfc-8127-b1adb2773d6d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:28.613152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200fce4-b475-4cfc-8127-b1adb2773d6d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:28.621756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a5b5d-f581-49e7-8c82-a9c81d979fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:28.622681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a5b5d-f581-49e7-8c82-a9c81d979fbc admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.623117 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a5b5d-f581-49e7-8c82-a9c81d979fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.623501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a5b5d-f581-49e7-8c82-a9c81d979fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.624507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a5b5d-f581-49e7-8c82-a9c81d979fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:28.626674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a5b5d-f581-49e7-8c82-a9c81d979fbc admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.639439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1302/2588] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:28 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:28.644221 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440be1-918f-4049-93cf-f670c68e18f3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:28.654208 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440be1-918f-4049-93cf-f670c68e18f3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:28.659643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737954-9b02-4d54-95eb-6d6f7536019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:28.660849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737954-9b02-4d54-95eb-6d6f7536019e admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.661131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737954-9b02-4d54-95eb-6d6f7536019e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.661576 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737954-9b02-4d54-95eb-6d6f7536019e admin admin] PATH_INFO: `/v3/projects/42c2facd8241484ca3a3f93d8850dbe1/users/6d0d8ab0edcd4c44814a17b0c448922a/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.677520 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88737954-9b02-4d54-95eb-6d6f7536019e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c2facd8241484ca3a3f93d8850dbe1, user_id=6d0d8ab0edcd4c44814a17b0c448922a, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:28.680246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88737954-9b02-4d54-95eb-6d6f7536019e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.699775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1287/2589] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:28 2021] PUT /identity/v3/projects/42c2facd8241484ca3a3f93d8850dbe1/users/6d0d8ab0edcd4c44814a17b0c448922a/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:28.710909 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf2ac-27d2-4c57-b913-bff7685a00af None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.711347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf2ac-27d2-4c57-b913-bff7685a00af None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.711748 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf2ac-27d2-4c57-b913-bff7685a00af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.748645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d8baf2ac-27d2-4c57-b913-bff7685a00af None None] MFA Rules not processed for user `6d0d8ab0edcd4c44814a17b0c448922a`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:28.750294 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d8baf2ac-27d2-4c57-b913-bff7685a00af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:28.826101 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1303/2590] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:28 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:28.830658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737954-9b02-4d54-95eb-6d6f7536019e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:28.921492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737954-9b02-4d54-95eb-6d6f7536019e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:28.927938 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be11ca-b7ec-4ded-9f15-19a87f7916e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:28.928389 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be11ca-b7ec-4ded-9f15-19a87f7916e4 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:28.928746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be11ca-b7ec-4ded-9f15-19a87f7916e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:28.929107 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be11ca-b7ec-4ded-9f15-19a87f7916e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:28.929870 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be11ca-b7ec-4ded-9f15-19a87f7916e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:28.931925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be11ca-b7ec-4ded-9f15-19a87f7916e4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:28.965462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1288/2591] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:28 2021] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:28.967800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf2ac-27d2-4c57-b913-bff7685a00af None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:28.994063 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf2ac-27d2-4c57-b913-bff7685a00af None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:29.084878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fac3-60d3-402b-a6e0-bfa434a4a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:29.085649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fac3-60d3-402b-a6e0-bfa434a4a52e admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:29.085932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fac3-60d3-402b-a6e0-bfa434a4a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:29.086206 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fac3-60d3-402b-a6e0-bfa434a4a52e admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:29.087238 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69fac3-60d3-402b-a6e0-bfa434a4a52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:29.089262 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69fac3-60d3-402b-a6e0-bfa434a4a52e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:29.115908 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1304/2592] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:28 2021] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:12:29.119967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be11ca-b7ec-4ded-9f15-19a87f7916e4 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:29.130778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be11ca-b7ec-4ded-9f15-19a87f7916e4 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:29.135367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b4bc-0acb-4efc-b3a9-9bdc3e4a6e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:29.136081 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b4bc-0acb-4efc-b3a9-9bdc3e4a6e2d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:29.136367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b4bc-0acb-4efc-b3a9-9bdc3e4a6e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:29.136645 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b4bc-0acb-4efc-b3a9-9bdc3e4a6e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:29.137371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93b4bc-0acb-4efc-b3a9-9bdc3e4a6e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:29.138990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93b4bc-0acb-4efc-b3a9-9bdc3e4a6e2d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:29.150684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1289/2593] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:29.154735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fac3-60d3-402b-a6e0-bfa434a4a52e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:29.164549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fac3-60d3-402b-a6e0-bfa434a4a52e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:29.173011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1ce5b-fd8e-4400-a772-d487ead06efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:29.173965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1ce5b-fd8e-4400-a772-d487ead06efc admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:29.174301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1ce5b-fd8e-4400-a772-d487ead06efc admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:29.174592 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1ce5b-fd8e-4400-a772-d487ead06efc admin admin] PATH_INFO: `/v3/projects/e8197e5a03d84386afc4a28d3365c77f/users/c8d97da2f7b64b76aa9103e2efacc458/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:29.191118 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1ce5b-fd8e-4400-a772-d487ead06efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8197e5a03d84386afc4a28d3365c77f, user_id=c8d97da2f7b64b76aa9103e2efacc458, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:29.193829 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1ce5b-fd8e-4400-a772-d487ead06efc admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:29.207343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1305/2594] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:29 2021] PUT /identity/v3/projects/e8197e5a03d84386afc4a28d3365c77f/users/c8d97da2f7b64b76aa9103e2efacc458/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:29.211559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b4bc-0acb-4efc-b3a9-9bdc3e4a6e2d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:29.222259 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b4bc-0acb-4efc-b3a9-9bdc3e4a6e2d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:29.286699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6d64-7dd1-4ff9-add5-1c94f612918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:29.287334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6d64-7dd1-4ff9-add5-1c94f612918d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:29.287565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6d64-7dd1-4ff9-add5-1c94f612918d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:29.287868 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6d64-7dd1-4ff9-add5-1c94f612918d admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:29.288596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d6d64-7dd1-4ff9-add5-1c94f612918d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:29.290298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d6d64-7dd1-4ff9-add5-1c94f612918d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:29.301867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1290/2595] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:29 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:29.306127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1ce5b-fd8e-4400-a772-d487ead06efc admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:29.316486 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1ce5b-fd8e-4400-a772-d487ead06efc admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:29.321172 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:29.322070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:29.322351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:29.322630 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] PATH_INFO: `/v3/projects/e8197e5a03d84386afc4a28d3365c77f/users/c8d97da2f7b64b76aa9103e2efacc458/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:29.324544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8197e5a03d84386afc4a28d3365c77f, user_id=c8d97da2f7b64b76aa9103e2efacc458, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:29.327292 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:29.349438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1306/2596] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:29 2021] PUT /identity/v3/projects/e8197e5a03d84386afc4a28d3365c77f/users/c8d97da2f7b64b76aa9103e2efacc458/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:29.351501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aaa88-99a7-4abe-8fea-22709c4f6168 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:29.351942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aaa88-99a7-4abe-8fea-22709c4f6168 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:29.352323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aaa88-99a7-4abe-8fea-22709c4f6168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:29.384471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-764aaa88-99a7-4abe-8fea-22709c4f6168 None None] MFA Rules not processed for user `c8d97da2f7b64b76aa9103e2efacc458`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:29.385689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-764aaa88-99a7-4abe-8fea-22709c4f6168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:29.487785 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1291/2597] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:29 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:29.497997 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:29.499688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:29.559022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2840dcf-edf3-4cdf-8ac9-8e94c03cd352 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:29.562631 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9f9b1-9d9c-4386-8392-2ad7f67bcc58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:29.563282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9f9b1-9d9c-4386-8392-2ad7f67bcc58 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:29.563560 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9f9b1-9d9c-4386-8392-2ad7f67bcc58 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:29.563878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9f9b1-9d9c-4386-8392-2ad7f67bcc58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:29.573349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9f9b1-9d9c-4386-8392-2ad7f67bcc58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:29.574802 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9f9b1-9d9c-4386-8392-2ad7f67bcc58 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:29.587549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1307/2598] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:29 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:29.692918 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aaa88-99a7-4abe-8fea-22709c4f6168 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:29.694398 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-764aaa88-99a7-4abe-8fea-22709c4f6168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:29.706598 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aaa88-99a7-4abe-8fea-22709c4f6168 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:29.710162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038cbc-e36c-4a11-82dd-b13b28c18c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:29.710817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038cbc-e36c-4a11-82dd-b13b28c18c73 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:29.711103 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038cbc-e36c-4a11-82dd-b13b28c18c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:29.711378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038cbc-e36c-4a11-82dd-b13b28c18c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:29.772908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038cbc-e36c-4a11-82dd-b13b28c18c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:29.774475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038cbc-e36c-4a11-82dd-b13b28c18c73 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:29.784050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1292/2599] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:29 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:32.370760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9f9b1-9d9c-4386-8392-2ad7f67bcc58 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:32.431982 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9f9b1-9d9c-4386-8392-2ad7f67bcc58 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:32.436265 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:32.437128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:32.437410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:32.437683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] PATH_INFO: `/v3/users/6d0d8ab0edcd4c44814a17b0c448922a` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:32.438805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0d8ab0edcd4c44814a17b0c448922a)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:32.441351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:32.488071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0d8ab0edcd4c44814a17b0c448922a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:32.499182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0d8ab0edcd4c44814a17b0c448922a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:32.506274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0d8ab0edcd4c44814a17b0c448922a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:32.506932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0d8ab0edcd4c44814a17b0c448922a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:32.514481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0d8ab0edcd4c44814a17b0c448922a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:32.520582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1308/2600] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:32 2021] DELETE /identity/v3/users/6d0d8ab0edcd4c44814a17b0c448922a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:32.525476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eb31b-4bcc-409e-ad34-fc69dd02e126 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:32.525953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eb31b-4bcc-409e-ad34-fc69dd02e126 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:32.526027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eb31b-4bcc-409e-ad34-fc69dd02e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:32.542900 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-323eb31b-4bcc-409e-ad34-fc69dd02e126 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:32.544141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-323eb31b-4bcc-409e-ad34-fc69dd02e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:32.609804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1293/2601] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:32.620079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:32.621417 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:32.678226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4b7d5-425a-4273-b1e2-3e902712a97c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:32.681719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ec4e1-85fe-41de-b17d-e21f5077c9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:32.682369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ec4e1-85fe-41de-b17d-e21f5077c9fa service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:32.682653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ec4e1-85fe-41de-b17d-e21f5077c9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:32.683402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ec4e1-85fe-41de-b17d-e21f5077c9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:32.691958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ec4e1-85fe-41de-b17d-e21f5077c9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:32.693393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ec4e1-85fe-41de-b17d-e21f5077c9fa service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:32.702442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1309/2602] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:12:33.006672 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eb31b-4bcc-409e-ad34-fc69dd02e126 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:33.008249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-323eb31b-4bcc-409e-ad34-fc69dd02e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:33.019818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eb31b-4bcc-409e-ad34-fc69dd02e126 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:33.024644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:33.025644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:33.025942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:33.026220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] PATH_INFO: `/v3/projects/42c2facd8241484ca3a3f93d8850dbe1` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:33.027543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c2facd8241484ca3a3f93d8850dbe1)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:33.029529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:33.077858 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c2facd8241484ca3a3f93d8850dbe1', 'request_id': 'req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.085338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c2facd8241484ca3a3f93d8850dbe1', 'request_id': 'req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.092707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c2facd8241484ca3a3f93d8850dbe1', 'request_id': 'req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.103667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] The token cache is being invalidate because project 42c2facd8241484ca3a3f93d8850dbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:33.103998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.104628 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.106170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1294/2603] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:33 2021] DELETE /identity/v3/projects/42c2facd8241484ca3a3f93d8850dbe1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:33.110362 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ec4e1-85fe-41de-b17d-e21f5077c9fa service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:33.119641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ec4e1-85fe-41de-b17d-e21f5077c9fa service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:33.177275 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:33.178136 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:33.178426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:33.178682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] PATH_INFO: `/v3/users/c8d97da2f7b64b76aa9103e2efacc458` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:33.179844 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d97da2f7b64b76aa9103e2efacc458)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:33.181738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:33.231937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d97da2f7b64b76aa9103e2efacc458'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.245405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d97da2f7b64b76aa9103e2efacc458'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.252832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d97da2f7b64b76aa9103e2efacc458'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.253646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d97da2f7b64b76aa9103e2efacc458'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.261074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3050c0e0-b756-4057-b38f-0eb2947866ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d97da2f7b64b76aa9103e2efacc458'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.266870 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1310/2604] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:33 2021] DELETE /identity/v3/users/c8d97da2f7b64b76aa9103e2efacc458 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:33.552182 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:33.553566 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:33.566109 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9ec0-f60a-4e2d-a497-00d0edbf0762 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:33.626144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:33.627138 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:33.627966 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:33.628241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] PATH_INFO: `/v3/projects/e8197e5a03d84386afc4a28d3365c77f` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:33.629379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8197e5a03d84386afc4a28d3365c77f)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:33.631267 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:33.676640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8197e5a03d84386afc4a28d3365c77f', 'request_id': 'req-65756001-e491-412a-8a3f-7b5166a8e9ef'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.682642 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8197e5a03d84386afc4a28d3365c77f', 'request_id': 'req-65756001-e491-412a-8a3f-7b5166a8e9ef'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.690299 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8197e5a03d84386afc4a28d3365c77f', 'request_id': 'req-65756001-e491-412a-8a3f-7b5166a8e9ef'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.700465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] The token cache is being invalidate because project e8197e5a03d84386afc4a28d3365c77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:33.700775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.701438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-65756001-e491-412a-8a3f-7b5166a8e9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:33.703533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1295/2605] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:33 2021] DELETE /identity/v3/projects/e8197e5a03d84386afc4a28d3365c77f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:33.710966 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877c0e8-cbb7-45cf-9d03-82cb74d0d560 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:33.711471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877c0e8-cbb7-45cf-9d03-82cb74d0d560 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:33.711549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877c0e8-cbb7-45cf-9d03-82cb74d0d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:33.730379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-e877c0e8-cbb7-45cf-9d03-82cb74d0d560 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:33.731556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e877c0e8-cbb7-45cf-9d03-82cb74d0d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:33.788672 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1311/2606] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:33.842580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d726-7ad0-4881-b889-e23c903ed34a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:33.842867 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d726-7ad0-4881-b889-e23c903ed34a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:33.843142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d726-7ad0-4881-b889-e23c903ed34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:33.861064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-cf13d726-7ad0-4881-b889-e23c903ed34a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:33.862734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-cf13d726-7ad0-4881-b889-e23c903ed34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:33.870589 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1296/2607] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:33.874862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877c0e8-cbb7-45cf-9d03-82cb74d0d560 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:33.884967 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877c0e8-cbb7-45cf-9d03-82cb74d0d560 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:33.889202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:33.889854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:33.890132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:33.890401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:33.891112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:12:33.891412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:33.893163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:33.904799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1312/2608] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:12:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:12:33.909088 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13d726-7ad0-4881-b889-e23c903ed34a None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:33.917944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13d726-7ad0-4881-b889-e23c903ed34a None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:33.922472 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ea1c8-372c-4da7-a746-83dd1c771a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:33.923118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea1c8-372c-4da7-a746-83dd1c771a3a admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:33.923399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea1c8-372c-4da7-a746-83dd1c771a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:33.923678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea1c8-372c-4da7-a746-83dd1c771a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:33.924911 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ea1c8-372c-4da7-a746-83dd1c771a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:33.926796 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ea1c8-372c-4da7-a746-83dd1c771a3a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:33.952055 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1297/2609] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:33 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:12:33.955917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:33.965026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6b916-ca84-49c2-8d49-ab2a4cb014a7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:34.018913 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3e51f-c2e0-4218-8925-5f2daa6fca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:34.019584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3e51f-c2e0-4218-8925-5f2daa6fca60 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.019897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3e51f-c2e0-4218-8925-5f2daa6fca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.020172 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3e51f-c2e0-4218-8925-5f2daa6fca60 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.020856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3e51f-c2e0-4218-8925-5f2daa6fca60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:34.022750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3e51f-c2e0-4218-8925-5f2daa6fca60 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:34.042682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1313/2610] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:33 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:34.046601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ea1c8-372c-4da7-a746-83dd1c771a3a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:34.056665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ea1c8-372c-4da7-a746-83dd1c771a3a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:34.061087 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a83fc-d55b-4af5-8bb9-4c945cc3d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:34.061745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a83fc-d55b-4af5-8bb9-4c945cc3d5ba admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.062030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a83fc-d55b-4af5-8bb9-4c945cc3d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.062337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a83fc-d55b-4af5-8bb9-4c945cc3d5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.063058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a83fc-d55b-4af5-8bb9-4c945cc3d5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:34.064697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a83fc-d55b-4af5-8bb9-4c945cc3d5ba admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:34.075634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1298/2611] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:34.079874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3e51f-c2e0-4218-8925-5f2daa6fca60 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:34.093339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3e51f-c2e0-4218-8925-5f2daa6fca60 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:34.098513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916751d2-0719-4b3c-916d-f143be0ece7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:34.099185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916751d2-0719-4b3c-916d-f143be0ece7d admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.099475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916751d2-0719-4b3c-916d-f143be0ece7d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.099777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916751d2-0719-4b3c-916d-f143be0ece7d admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.100502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916751d2-0719-4b3c-916d-f143be0ece7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:34.102096 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916751d2-0719-4b3c-916d-f143be0ece7d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:34.112535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1314/2612] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:34.116733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a83fc-d55b-4af5-8bb9-4c945cc3d5ba admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:34.126215 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a83fc-d55b-4af5-8bb9-4c945cc3d5ba admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:34.131189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:34.132127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.132409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.132683 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] PATH_INFO: `/v3/projects/65b2120ff954436f8cba6db27b99828b/users/e0ad3465cd5448c2b7b281e398ff99da/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.147895 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b2120ff954436f8cba6db27b99828b, user_id=e0ad3465cd5448c2b7b281e398ff99da, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:34.150468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:34.163498 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1299/2613] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:34 2021] PUT /identity/v3/projects/65b2120ff954436f8cba6db27b99828b/users/e0ad3465cd5448c2b7b281e398ff99da/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:34.173715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347890a6-9d1d-4d06-b1a6-5f462f608cfe None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.174127 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347890a6-9d1d-4d06-b1a6-5f462f608cfe None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.174435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347890a6-9d1d-4d06-b1a6-5f462f608cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.200658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-347890a6-9d1d-4d06-b1a6-5f462f608cfe None None] MFA Rules not processed for user `e0ad3465cd5448c2b7b281e398ff99da`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:34.201830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-347890a6-9d1d-4d06-b1a6-5f462f608cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:34.265046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1315/2614] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:34 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:34.275906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:34.278130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:34.333542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49cf5b-194a-4445-a142-435044b019cb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:34.337090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee2c5c-c146-46c5-bb19-76368389a697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:34.337733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2c5c-c146-46c5-bb19-76368389a697 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.338015 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2c5c-c146-46c5-bb19-76368389a697 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.338289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2c5c-c146-46c5-bb19-76368389a697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.346587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee2c5c-c146-46c5-bb19-76368389a697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:34.348042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee2c5c-c146-46c5-bb19-76368389a697 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:34.356473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1300/2615] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:34 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:12:34.376017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347890a6-9d1d-4d06-b1a6-5f462f608cfe None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:34.433981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347890a6-9d1d-4d06-b1a6-5f462f608cfe None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:34.438614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:34.439574 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.439962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.440431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] PATH_INFO: `/v3/users/e0ad3465cd5448c2b7b281e398ff99da` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.441693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ad3465cd5448c2b7b281e398ff99da)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:34.444072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:34.494191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ad3465cd5448c2b7b281e398ff99da'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:34.505950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ad3465cd5448c2b7b281e398ff99da'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:34.512438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ad3465cd5448c2b7b281e398ff99da'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:34.513143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ad3465cd5448c2b7b281e398ff99da'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:34.520779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ad3465cd5448c2b7b281e398ff99da'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:34.527089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1316/2616] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:34 2021] DELETE /identity/v3/users/e0ad3465cd5448c2b7b281e398ff99da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:34.531588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8d8b-5eb5-453b-ae9f-42c3fecd53a8 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.531898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8d8b-5eb5-453b-ae9f-42c3fecd53a8 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.532199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8d8b-5eb5-453b-ae9f-42c3fecd53a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.548853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-dfbe8d8b-5eb5-453b-ae9f-42c3fecd53a8 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:34.550024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-dfbe8d8b-5eb5-453b-ae9f-42c3fecd53a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:34.606049 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1301/2617] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:34.616683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:34.618057 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:34.674571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7181-aa6e-41bd-8941-0fc66c677118 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:34.678204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd70a7-dd44-444e-ad13-2dbb6ebc2742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:34.678865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd70a7-dd44-444e-ad13-2dbb6ebc2742 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:34.679165 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd70a7-dd44-444e-ad13-2dbb6ebc2742 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:34.679416 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd70a7-dd44-444e-ad13-2dbb6ebc2742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:34.688930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd70a7-dd44-444e-ad13-2dbb6ebc2742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:34.690434 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd70a7-dd44-444e-ad13-2dbb6ebc2742 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:34.699242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1317/2618] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:34.984037 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8d8b-5eb5-453b-ae9f-42c3fecd53a8 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:34.985490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-dfbe8d8b-5eb5-453b-ae9f-42c3fecd53a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:34.996807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8d8b-5eb5-453b-ae9f-42c3fecd53a8 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:35.001249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:35.002215 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.003155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.003438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] PATH_INFO: `/v3/projects/65b2120ff954436f8cba6db27b99828b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.004648 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b2120ff954436f8cba6db27b99828b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:35.006596 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:35.053928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b2120ff954436f8cba6db27b99828b', 'request_id': 'req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:35.059882 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b2120ff954436f8cba6db27b99828b', 'request_id': 'req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:35.067546 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b2120ff954436f8cba6db27b99828b', 'request_id': 'req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:35.078921 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] The token cache is being invalidate because project 65b2120ff954436f8cba6db27b99828b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:35.079180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:35.079852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cdb0da0a-670d-4d93-8e98-ae5fb09ee037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:35.082256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1302/2619] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:34 2021] DELETE /identity/v3/projects/65b2120ff954436f8cba6db27b99828b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:35.087957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3687ac-43b7-4ca1-8895-4c2dd0185481 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.088398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3687ac-43b7-4ca1-8895-4c2dd0185481 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.088606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3687ac-43b7-4ca1-8895-4c2dd0185481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.105412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ec3687ac-43b7-4ca1-8895-4c2dd0185481 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:35.106580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ec3687ac-43b7-4ca1-8895-4c2dd0185481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:35.164931 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1318/2620] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:35.172774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb36b3f-e4bd-4877-9d69-1bee53d667fc None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.173063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb36b3f-e4bd-4877-9d69-1bee53d667fc None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.173340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb36b3f-e4bd-4877-9d69-1bee53d667fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.193410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-4fb36b3f-e4bd-4877-9d69-1bee53d667fc None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:35.194795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-4fb36b3f-e4bd-4877-9d69-1bee53d667fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:35.202972 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1303/2621] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:12:35.208187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3687ac-43b7-4ca1-8895-4c2dd0185481 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:35.217077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3687ac-43b7-4ca1-8895-4c2dd0185481 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:35.221585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:35.222242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.222524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.222800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.223522 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:12:35.223873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:35.225490 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:35.236851 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1319/2622] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:12:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:12:35.240847 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb36b3f-e4bd-4877-9d69-1bee53d667fc None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:35.249748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb36b3f-e4bd-4877-9d69-1bee53d667fc None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:35.256460 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f087636-6187-42e7-8807-7f8f400a0c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:35.257212 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087636-6187-42e7-8807-7f8f400a0c3e admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.257619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087636-6187-42e7-8807-7f8f400a0c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.257962 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087636-6187-42e7-8807-7f8f400a0c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.258801 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f087636-6187-42e7-8807-7f8f400a0c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:35.261131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f087636-6187-42e7-8807-7f8f400a0c3e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:35.288142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1304/2623] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:35 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:35.292428 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:35.302345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe431f9-7c65-46d3-b8bd-efeca9339cbd admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:35.364850 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad56dbe-0b1d-4950-baa9-601760ee9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:35.365525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad56dbe-0b1d-4950-baa9-601760ee9e1d admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.365807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad56dbe-0b1d-4950-baa9-601760ee9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.366084 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad56dbe-0b1d-4950-baa9-601760ee9e1d admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.366774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad56dbe-0b1d-4950-baa9-601760ee9e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:35.368702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad56dbe-0b1d-4950-baa9-601760ee9e1d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:35.389442 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1320/2624] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:35 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:35.393554 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f087636-6187-42e7-8807-7f8f400a0c3e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:35.403002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f087636-6187-42e7-8807-7f8f400a0c3e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:35.407594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e7faf-4fd2-4609-a737-a2d4cf37f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:35.408281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7faf-4fd2-4609-a737-a2d4cf37f5ff admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.408609 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7faf-4fd2-4609-a737-a2d4cf37f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.408888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7faf-4fd2-4609-a737-a2d4cf37f5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.409611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e7faf-4fd2-4609-a737-a2d4cf37f5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:35.411229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e7faf-4fd2-4609-a737-a2d4cf37f5ff admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:35.421410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1305/2625] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:35 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:12:35.426138 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad56dbe-0b1d-4950-baa9-601760ee9e1d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:35.435977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad56dbe-0b1d-4950-baa9-601760ee9e1d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:35.441144 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99880a20-b7e7-4553-8ef2-5ae83a44f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:35.441823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880a20-b7e7-4553-8ef2-5ae83a44f903 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.442106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880a20-b7e7-4553-8ef2-5ae83a44f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.442384 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880a20-b7e7-4553-8ef2-5ae83a44f903 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.443106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99880a20-b7e7-4553-8ef2-5ae83a44f903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:35.444738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99880a20-b7e7-4553-8ef2-5ae83a44f903 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:35.455008 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1321/2626] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:35.459237 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e7faf-4fd2-4609-a737-a2d4cf37f5ff admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:35.468428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e7faf-4fd2-4609-a737-a2d4cf37f5ff admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:35.472707 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:35.473579 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.473855 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.474126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] PATH_INFO: `/v3/projects/34430e66fb6c415ba37d08c9522cfbd3/users/6f4eb931d55d4cfd923db928b65a804c/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.488976 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34430e66fb6c415ba37d08c9522cfbd3, user_id=6f4eb931d55d4cfd923db928b65a804c, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:35.491971 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:35.505957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1306/2627] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:35 2021] PUT /identity/v3/projects/34430e66fb6c415ba37d08c9522cfbd3/users/6f4eb931d55d4cfd923db928b65a804c/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:12:35.517013 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c8611-fde1-4da7-8a07-b084e9764ab0 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.517305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c8611-fde1-4da7-8a07-b084e9764ab0 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.517582 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c8611-fde1-4da7-8a07-b084e9764ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.546240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-740c8611-fde1-4da7-8a07-b084e9764ab0 None None] MFA Rules not processed for user `6f4eb931d55d4cfd923db928b65a804c`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:35.547591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-740c8611-fde1-4da7-8a07-b084e9764ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:35.612232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1322/2628] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:35 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:35.623080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:35.624739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:35.681606 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decdd6e-4d17-4335-8766-773f61989885 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:35.685101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e1a6-4715-4248-aa62-8b5e1a1494a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:35.685740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e1a6-4715-4248-aa62-8b5e1a1494a7 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:35.686019 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e1a6-4715-4248-aa62-8b5e1a1494a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:35.686291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e1a6-4715-4248-aa62-8b5e1a1494a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:35.694249 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e1a6-4715-4248-aa62-8b5e1a1494a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:35.695677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e1a6-4715-4248-aa62-8b5e1a1494a7 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:35.704141 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1307/2629] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:35 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:38.235779 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c8611-fde1-4da7-8a07-b084e9764ab0 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:38.296989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c8611-fde1-4da7-8a07-b084e9764ab0 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:38.302185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:38.303039 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:38.303314 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:38.303585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] PATH_INFO: `/v3/users/6f4eb931d55d4cfd923db928b65a804c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:38.304725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4eb931d55d4cfd923db928b65a804c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:38.306619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:38.352624 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4eb931d55d4cfd923db928b65a804c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.364780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4eb931d55d4cfd923db928b65a804c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.371283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4eb931d55d4cfd923db928b65a804c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.371976 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4eb931d55d4cfd923db928b65a804c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.379413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4eb931d55d4cfd923db928b65a804c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.385278 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1323/2630] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:38 2021] DELETE /identity/v3/users/6f4eb931d55d4cfd923db928b65a804c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:38.389790 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccce3fb-379f-4bd7-ab3f-4d74ccc4b022 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:38.390246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccce3fb-379f-4bd7-ab3f-4d74ccc4b022 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:38.390365 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccce3fb-379f-4bd7-ab3f-4d74ccc4b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:38.406831 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-6ccce3fb-379f-4bd7-ab3f-4d74ccc4b022 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:38.408166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6ccce3fb-379f-4bd7-ab3f-4d74ccc4b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:38.464558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1308/2631] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:38.474618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:38.475948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:38.533768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c03f5b-91c0-4dd2-b60e-81b2cc9b6826 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:38.537329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeff72d-2e2c-4c01-b3d5-8a540e7e456c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:38.537976 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff72d-2e2c-4c01-b3d5-8a540e7e456c service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:38.538258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff72d-2e2c-4c01-b3d5-8a540e7e456c service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:38.538532 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff72d-2e2c-4c01-b3d5-8a540e7e456c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:38.547146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeff72d-2e2c-4c01-b3d5-8a540e7e456c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:38.548612 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeff72d-2e2c-4c01-b3d5-8a540e7e456c service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:38.557793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1324/2632] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:38.829953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccce3fb-379f-4bd7-ab3f-4d74ccc4b022 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:38.831687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-6ccce3fb-379f-4bd7-ab3f-4d74ccc4b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:38.842808 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccce3fb-379f-4bd7-ab3f-4d74ccc4b022 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:38.847635 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:38.848521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:38.848804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:38.849076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] PATH_INFO: `/v3/projects/34430e66fb6c415ba37d08c9522cfbd3` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:38.850213 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=34430e66fb6c415ba37d08c9522cfbd3)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:38.852160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:38.899189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34430e66fb6c415ba37d08c9522cfbd3', 'request_id': 'req-623b1a13-6396-4ff3-89fa-90e7d613c2ab'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.905764 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34430e66fb6c415ba37d08c9522cfbd3', 'request_id': 'req-623b1a13-6396-4ff3-89fa-90e7d613c2ab'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.913428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34430e66fb6c415ba37d08c9522cfbd3', 'request_id': 'req-623b1a13-6396-4ff3-89fa-90e7d613c2ab'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.923248 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] The token cache is being invalidate because project 34430e66fb6c415ba37d08c9522cfbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:38.923531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.924769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-623b1a13-6396-4ff3-89fa-90e7d613c2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:38.926342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1309/2633] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:38 2021] DELETE /identity/v3/projects/34430e66fb6c415ba37d08c9522cfbd3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:38.932319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988361b-954f-4a0b-bbe1-79917837ddd4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:38.932608 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988361b-954f-4a0b-bbe1-79917837ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:38.932910 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988361b-954f-4a0b-bbe1-79917837ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:38.949656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6988361b-954f-4a0b-bbe1-79917837ddd4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:38.950805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6988361b-954f-4a0b-bbe1-79917837ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:39.007061 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1325/2634] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:39.016680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691173-7663-4cf6-9dc8-09646e941a46 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.017100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691173-7663-4cf6-9dc8-09646e941a46 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.017571 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691173-7663-4cf6-9dc8-09646e941a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.036848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-00691173-7663-4cf6-9dc8-09646e941a46 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:39.038025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-00691173-7663-4cf6-9dc8-09646e941a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:39.045367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1310/2635] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:39.050182 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988361b-954f-4a0b-bbe1-79917837ddd4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:39.059230 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988361b-954f-4a0b-bbe1-79917837ddd4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:39.063471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:39.064175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.064459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.065326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.066091 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:12:39.066401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:39.068032 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:39.080338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1326/2636] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:12:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:12:39.084542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691173-7663-4cf6-9dc8-09646e941a46 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:39.093149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691173-7663-4cf6-9dc8-09646e941a46 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:39.098317 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e234c-52aa-4922-a933-8b7410787621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:39.098977 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e234c-52aa-4922-a933-8b7410787621 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.099261 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e234c-52aa-4922-a933-8b7410787621 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.099539 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e234c-52aa-4922-a933-8b7410787621 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.100300 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e234c-52aa-4922-a933-8b7410787621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:39.102203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e234c-52aa-4922-a933-8b7410787621 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:39.133268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1311/2637] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:12:39 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:12:39.135936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:39.145468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b743e-b001-4d95-a8c9-15626e0b46e4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:39.199722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b5103-78c7-447a-96af-6932e701eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:39.200398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b5103-78c7-447a-96af-6932e701eb3c admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.200710 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b5103-78c7-447a-96af-6932e701eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.200981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b5103-78c7-447a-96af-6932e701eb3c admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.201650 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b5103-78c7-447a-96af-6932e701eb3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:39.203550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b5103-78c7-447a-96af-6932e701eb3c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:39.224475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1327/2638] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:12:39 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:12:39.228679 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e234c-52aa-4922-a933-8b7410787621 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:39.239775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e234c-52aa-4922-a933-8b7410787621 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:39.244290 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e72a4-bb1e-4a8c-b79c-96a76753f23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:39.244949 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e72a4-bb1e-4a8c-b79c-96a76753f23b admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.245234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e72a4-bb1e-4a8c-b79c-96a76753f23b admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.245511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e72a4-bb1e-4a8c-b79c-96a76753f23b admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.246261 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e72a4-bb1e-4a8c-b79c-96a76753f23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:39.247899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e72a4-bb1e-4a8c-b79c-96a76753f23b admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:39.258987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1312/2639] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:39.262776 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b5103-78c7-447a-96af-6932e701eb3c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:39.271945 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b5103-78c7-447a-96af-6932e701eb3c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:39.277121 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f29d6c-9b64-403d-871b-3c74edc27c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:39.277778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29d6c-9b64-403d-871b-3c74edc27c10 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.278062 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29d6c-9b64-403d-871b-3c74edc27c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.278340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29d6c-9b64-403d-871b-3c74edc27c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.279060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f29d6c-9b64-403d-871b-3c74edc27c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:39.280689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f29d6c-9b64-403d-871b-3c74edc27c10 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:39.290331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1328/2640] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:12:39 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:12:39.294279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e72a4-bb1e-4a8c-b79c-96a76753f23b admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:39.304016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e72a4-bb1e-4a8c-b79c-96a76753f23b admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:39.308432 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:39.309295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.309580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.309861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] PATH_INFO: `/v3/projects/8b5fd91362184965a59d24f6aedfa562/users/c37a073828554cb1b2f3a0eb4883dec3/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.324641 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5fd91362184965a59d24f6aedfa562, user_id=c37a073828554cb1b2f3a0eb4883dec3, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:39.327814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:39.344278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1313/2641] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:12:39 2021] PUT /identity/v3/projects/8b5fd91362184965a59d24f6aedfa562/users/c37a073828554cb1b2f3a0eb4883dec3/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:39.354539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb338-42c4-4945-be09-25a437fcf662 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.354827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb338-42c4-4945-be09-25a437fcf662 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.355102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb338-42c4-4945-be09-25a437fcf662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.381904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0c9eb338-42c4-4945-be09-25a437fcf662 None None] MFA Rules not processed for user `c37a073828554cb1b2f3a0eb4883dec3`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:39.383077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0c9eb338-42c4-4945-be09-25a437fcf662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:39.446821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1329/2642] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:39 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:39.457071 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:39.458781 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:39.514001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7604f-485b-4998-8661-72d5e18f9553 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:39.519523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fa1b5-8d69-43da-b55c-96a3796becd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:39.520202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fa1b5-8d69-43da-b55c-96a3796becd8 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:39.520487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fa1b5-8d69-43da-b55c-96a3796becd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:39.520763 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fa1b5-8d69-43da-b55c-96a3796becd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:39.529076 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fa1b5-8d69-43da-b55c-96a3796becd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:39.530552 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fa1b5-8d69-43da-b55c-96a3796becd8 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:39.540547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1314/2643] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:39 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:53.372646 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb338-42c4-4945-be09-25a437fcf662 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:53.435383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb338-42c4-4945-be09-25a437fcf662 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:53.439749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:53.441475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:53.441809 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:53.442079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] PATH_INFO: `/v3/users/c37a073828554cb1b2f3a0eb4883dec3` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:53.443220 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37a073828554cb1b2f3a0eb4883dec3)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:53.445213 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:53.489399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37a073828554cb1b2f3a0eb4883dec3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:53.501641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37a073828554cb1b2f3a0eb4883dec3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:53.508901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37a073828554cb1b2f3a0eb4883dec3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:53.509563 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37a073828554cb1b2f3a0eb4883dec3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:53.516512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37a073828554cb1b2f3a0eb4883dec3'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:53.522569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1330/2644] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:12:53 2021] DELETE /identity/v3/users/c37a073828554cb1b2f3a0eb4883dec3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:53.527034 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501405-bfbb-4aa5-bbae-55803fe3efbf None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:53.527475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501405-bfbb-4aa5-bbae-55803fe3efbf None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:53.527575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501405-bfbb-4aa5-bbae-55803fe3efbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:53.544192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-47501405-bfbb-4aa5-bbae-55803fe3efbf None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:53.545340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-47501405-bfbb-4aa5-bbae-55803fe3efbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:53.610836 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1315/2645] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:53.621475 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:53.622864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:53.678995 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc67e01-880d-46ee-84f1-33bf402e9712 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:53.682551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d40a10-eda3-457c-8bad-531d0b0f5d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:53.683193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d40a10-eda3-457c-8bad-531d0b0f5d9d service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:53.683474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d40a10-eda3-457c-8bad-531d0b0f5d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:53.683773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d40a10-eda3-457c-8bad-531d0b0f5d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:53.692344 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d40a10-eda3-457c-8bad-531d0b0f5d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:53.693761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d40a10-eda3-457c-8bad-531d0b0f5d9d service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:53.702470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1331/2646] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:53.978061 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501405-bfbb-4aa5-bbae-55803fe3efbf None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:53.979443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-47501405-bfbb-4aa5-bbae-55803fe3efbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:53.991514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501405-bfbb-4aa5-bbae-55803fe3efbf None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:53.995922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:53.996806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:53.997071 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:53.997345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] PATH_INFO: `/v3/projects/8b5fd91362184965a59d24f6aedfa562` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:53.998485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5fd91362184965a59d24f6aedfa562)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:54.000445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:54.045703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5fd91362184965a59d24f6aedfa562', 'request_id': 'req-9d32a845-f5a1-4c1a-96d3-0b1105371878'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:54.051970 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5fd91362184965a59d24f6aedfa562', 'request_id': 'req-9d32a845-f5a1-4c1a-96d3-0b1105371878'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:54.059000 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5fd91362184965a59d24f6aedfa562', 'request_id': 'req-9d32a845-f5a1-4c1a-96d3-0b1105371878'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:54.068898 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] The token cache is being invalidate because project 8b5fd91362184965a59d24f6aedfa562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:54.069166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:54.069783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:54.071491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1316/2647] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:12:53 2021] DELETE /identity/v3/projects/8b5fd91362184965a59d24f6aedfa562 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:12:58.094266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5a28-5f9e-416d-a525-994ddc165bbe None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:58.094750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5a28-5f9e-416d-a525-994ddc165bbe None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:58.094857 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5a28-5f9e-416d-a525-994ddc165bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:58.112074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0e5e5a28-5f9e-416d-a525-994ddc165bbe None None] MFA Rules not processed for user `21290886e90f45f582840b785d64cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:58.113768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0e5e5a28-5f9e-416d-a525-994ddc165bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:58.165586 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1332/2648] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:12:58 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:58.211690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:58.213136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:58.268124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32a845-f5a1-4c1a-96d3-0b1105371878 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:58.272221 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:58.272860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:58.273142 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:58.273415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:58.275118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:58.347391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:58.348859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:58.359356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1317/2649] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:58 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:58.881431 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5a28-5f9e-416d-a525-994ddc165bbe None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:58.882781 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0e5e5a28-5f9e-416d-a525-994ddc165bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:58.935831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5a28-5f9e-416d-a525-994ddc165bbe None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:58.939175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:58.939856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:58.940131 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:58.940450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:58.942301 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:58.950834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:58.952295 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:58.959694 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1333/2650] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:58 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:59.392727 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:59.394967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:59.461961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa391181-13e9-419e-815e-d9419ecde2ef service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:59.466720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:59.467367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:59.467651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:59.467957 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:59.469668 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:59.480703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:59.482553 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:59.492022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1318/2651] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:59 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:59.591816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:59.593311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:59.607549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671c99a-6826-4814-ae9e-5b47964dad50 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:59.612254 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:59.612936 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:59.613219 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:59.613499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:59.615159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:59.625548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:59.627181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:59.636972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1334/2652] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:12:59 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:01.275534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:01.277047 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:01.292008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49daf1-8e39-4d51-b71f-c72e03c125ae service placement] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:01.295446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:01.296129 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:01.296413 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:01.296686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:01.298449 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:01.308294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:01.309734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:01.318119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1319/2653] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:01.966980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:01.968919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:01.990901 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e089b8b-c48b-4359-90c4-19c9d8c0e885 service placement] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:01.997106 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a4126-a6d2-41e9-8f87-f4dc0d3361fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:01.997926 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a4126-a6d2-41e9-8f87-f4dc0d3361fe service nova] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:01.998316 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a4126-a6d2-41e9-8f87-f4dc0d3361fe service nova] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:01.998697 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a4126-a6d2-41e9-8f87-f4dc0d3361fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:02.000636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f57a4126-a6d2-41e9-8f87-f4dc0d3361fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:02.021533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a4126-a6d2-41e9-8f87-f4dc0d3361fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:02.023530 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a4126-a6d2-41e9-8f87-f4dc0d3361fe service nova] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:02.036953 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1335/2654] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:02.901307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:02.902789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:02.965057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ed8db-21b3-4b63-ba4e-a5456d557ad1 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:02.969463 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:02.970313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:02.970593 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:02.970860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] PATH_INFO: `/v3/users/9d593c944bfc4a2c970fce753aac50f2` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:02.972776 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d593c944bfc4a2c970fce753aac50f2)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:02.974686 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.020861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d593c944bfc4a2c970fce753aac50f2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.032203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d593c944bfc4a2c970fce753aac50f2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.032869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d593c944bfc4a2c970fce753aac50f2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.041126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d593c944bfc4a2c970fce753aac50f2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.041739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d593c944bfc4a2c970fce753aac50f2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.053905 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1320/2655] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:13:02 2021] DELETE /identity/v3/users/9d593c944bfc4a2c970fce753aac50f2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:03.058573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6edc2d-68c2-40a0-b778-5402e3c98f49 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.059073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6edc2d-68c2-40a0-b778-5402e3c98f49 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.059169 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6edc2d-68c2-40a0-b778-5402e3c98f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.076143 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-0c6edc2d-68c2-40a0-b778-5402e3c98f49 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:03.077312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0c6edc2d-68c2-40a0-b778-5402e3c98f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:03.133714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1336/2656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:03.144217 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:03.145547 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:03.199174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2b36c-8f42-4985-8362-3b2a9e0e96c8 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:03.202677 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a3f24-bf83-4a48-b6b5-925674e0f32b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:03.203326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3f24-bf83-4a48-b6b5-925674e0f32b service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.203607 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3f24-bf83-4a48-b6b5-925674e0f32b service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.203908 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3f24-bf83-4a48-b6b5-925674e0f32b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.213358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a3f24-bf83-4a48-b6b5-925674e0f32b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:03.214789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a3f24-bf83-4a48-b6b5-925674e0f32b service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.224157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1321/2657] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:03.490087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6edc2d-68c2-40a0-b778-5402e3c98f49 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:03.491550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-0c6edc2d-68c2-40a0-b778-5402e3c98f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:03.504246 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6edc2d-68c2-40a0-b778-5402e3c98f49 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:03.508657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:03.509506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.509780 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.510050 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] PATH_INFO: `/v3/projects/2a7e525a55fd498fa09a2ca59115a1dc` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.511168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7e525a55fd498fa09a2ca59115a1dc)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:03.513822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.558394 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7e525a55fd498fa09a2ca59115a1dc', 'request_id': 'req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.564351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7e525a55fd498fa09a2ca59115a1dc', 'request_id': 'req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.571670 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7e525a55fd498fa09a2ca59115a1dc', 'request_id': 'req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.583565 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] The token cache is being invalidate because project 2a7e525a55fd498fa09a2ca59115a1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:03.583897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.584536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-3d15d727-d5ac-4769-ac50-8bf3ce9f038b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:03.586467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1337/2658] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:13:03 2021] DELETE /identity/v3/projects/2a7e525a55fd498fa09a2ca59115a1dc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:03.593926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b38c-5b2e-4951-9174-967a774396e1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.594424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b38c-5b2e-4951-9174-967a774396e1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.594732 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b38c-5b2e-4951-9174-967a774396e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.612689 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-b358b38c-5b2e-4951-9174-967a774396e1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:03.613857 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-b358b38c-5b2e-4951-9174-967a774396e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:03.670503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1322/2659] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:03.678048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede250f3-79af-4023-a89f-d0cfb424b085 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.678335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede250f3-79af-4023-a89f-d0cfb424b085 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.678627 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede250f3-79af-4023-a89f-d0cfb424b085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.696852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ede250f3-79af-4023-a89f-d0cfb424b085 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:03.698015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ede250f3-79af-4023-a89f-d0cfb424b085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:03.705355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1338/2660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:03.710360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b38c-5b2e-4951-9174-967a774396e1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:03.719252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b38c-5b2e-4951-9174-967a774396e1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:03.723826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:03.724476 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.724757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.725033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.725750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:03.726057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:03.727650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.739803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1323/2661] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:13:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:03.743689 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede250f3-79af-4023-a89f-d0cfb424b085 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:03.752078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede250f3-79af-4023-a89f-d0cfb424b085 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:03.756558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89908b-bbde-4cd0-8d4c-a6a2b5f5362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:03.757198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89908b-bbde-4cd0-8d4c-a6a2b5f5362f admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.757483 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89908b-bbde-4cd0-8d4c-a6a2b5f5362f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.757759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89908b-bbde-4cd0-8d4c-a6a2b5f5362f admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.758435 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89908b-bbde-4cd0-8d4c-a6a2b5f5362f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:03.760374 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89908b-bbde-4cd0-8d4c-a6a2b5f5362f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.785148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1339/2662] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:03 2021] POST /identity/v3/projects => generated 391 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:03.789127 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:03.798393 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3d323-aff2-4718-9ffc-9cdbd188a69e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:03.852146 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df747a-7239-4985-8f7b-e7a41c41008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:03.852798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df747a-7239-4985-8f7b-e7a41c41008d admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.853080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df747a-7239-4985-8f7b-e7a41c41008d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.853452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df747a-7239-4985-8f7b-e7a41c41008d admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.854136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df747a-7239-4985-8f7b-e7a41c41008d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:03.856113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df747a-7239-4985-8f7b-e7a41c41008d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.881334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1324/2663] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:03 2021] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:03.882448 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89908b-bbde-4cd0-8d4c-a6a2b5f5362f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:03.891930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89908b-bbde-4cd0-8d4c-a6a2b5f5362f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:03.896266 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc036f-4de9-46fc-ab23-a0b00d96fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:03.896923 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc036f-4de9-46fc-ab23-a0b00d96fef5 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.897199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc036f-4de9-46fc-ab23-a0b00d96fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.897479 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc036f-4de9-46fc-ab23-a0b00d96fef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.898190 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc036f-4de9-46fc-ab23-a0b00d96fef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:03.899821 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc036f-4de9-46fc-ab23-a0b00d96fef5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.910103 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1340/2664] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:03 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:03.914028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df747a-7239-4985-8f7b-e7a41c41008d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:03.925192 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df747a-7239-4985-8f7b-e7a41c41008d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:03.929453 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e0b2a-1f53-435b-a5e3-ea9f4f4bd332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:03.930113 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0b2a-1f53-435b-a5e3-ea9f4f4bd332 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.930391 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0b2a-1f53-435b-a5e3-ea9f4f4bd332 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.930663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0b2a-1f53-435b-a5e3-ea9f4f4bd332 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.931374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e0b2a-1f53-435b-a5e3-ea9f4f4bd332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:03.933002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e0b2a-1f53-435b-a5e3-ea9f4f4bd332 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.944575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1325/2665] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:03.948739 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc036f-4de9-46fc-ab23-a0b00d96fef5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:03.958527 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc036f-4de9-46fc-ab23-a0b00d96fef5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:03.962937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:03.963950 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:03.964240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:03.964512 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] PATH_INFO: `/v3/projects/0cdfd9708f3643daa28cf7b9afa4c5c7/users/0e6fddb60cbd4e10a88af67569f17eea/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:03.979022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdfd9708f3643daa28cf7b9afa4c5c7, user_id=0e6fddb60cbd4e10a88af67569f17eea, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:03.981674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:03.995497 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1341/2666] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:03 2021] PUT /identity/v3/projects/0cdfd9708f3643daa28cf7b9afa4c5c7/users/0e6fddb60cbd4e10a88af67569f17eea/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:04.006183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce68d3-383e-4f72-bd65-eb937fb157c5 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:04.006473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce68d3-383e-4f72-bd65-eb937fb157c5 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:04.006838 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce68d3-383e-4f72-bd65-eb937fb157c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:04.032492 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-70ce68d3-383e-4f72-bd65-eb937fb157c5 None None] MFA Rules not processed for user `0e6fddb60cbd4e10a88af67569f17eea`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:04.033653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-70ce68d3-383e-4f72-bd65-eb937fb157c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:04.094885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1326/2667] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:04 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:04.105418 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:04.107071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:04.162403 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace8cc-2990-4445-9a25-965df79558b6 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:04.166048 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:04.166682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:04.166964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:04.167241 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:04.175548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:04.176964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:04.185137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1342/2668] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:04 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:16.266022 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce68d3-383e-4f72-bd65-eb937fb157c5 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:16.267466 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-70ce68d3-383e-4f72-bd65-eb937fb157c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:16.341885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce68d3-383e-4f72-bd65-eb937fb157c5 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:16.347131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:16.347798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:16.348083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:16.348355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:16.350078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:16.361105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:16.362627 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:16.372298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1327/2669] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:19.180846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:19.182329 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:19.236639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b886-0500-40a6-9425-d79b0b57d8b6 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:19.240336 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:19.240971 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:19.241249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:19.241521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:19.243176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:19.302492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:19.303955 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:19.312874 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1343/2670] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:19 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:13:20.902380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:20.915210 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac39d2-1f54-4d86-b06e-15d7ae7a9a66 service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:20.921266 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b91a1-c45f-44eb-905f-65db48933ec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:20.921924 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b91a1-c45f-44eb-905f-65db48933ec4 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:20.922211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b91a1-c45f-44eb-905f-65db48933ec4 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:20.922489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b91a1-c45f-44eb-905f-65db48933ec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:20.924265 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-446b91a1-c45f-44eb-905f-65db48933ec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:20.936771 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b91a1-c45f-44eb-905f-65db48933ec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:20.938536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b91a1-c45f-44eb-905f-65db48933ec4 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:20.949513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1328/2671] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:23.378948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.438501 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30950c-5c76-48e8-923c-c3f85c392cd8 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.443858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.444722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.444998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.445267 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] PATH_INFO: `/v3/users/0e6fddb60cbd4e10a88af67569f17eea` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.446399 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6fddb60cbd4e10a88af67569f17eea)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.448349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.502258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6fddb60cbd4e10a88af67569f17eea'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.513983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6fddb60cbd4e10a88af67569f17eea'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.520594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6fddb60cbd4e10a88af67569f17eea'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.521248 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6fddb60cbd4e10a88af67569f17eea'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.528052 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6fddb60cbd4e10a88af67569f17eea'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.533762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1344/2672] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:13:23 2021] DELETE /identity/v3/users/0e6fddb60cbd4e10a88af67569f17eea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:23.538484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224b16-7c54-4ceb-91ce-6b6564f6719a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.538981 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224b16-7c54-4ceb-91ce-6b6564f6719a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.539090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224b16-7c54-4ceb-91ce-6b6564f6719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.556171 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-33224b16-7c54-4ceb-91ce-6b6564f6719a None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:23.557321 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-33224b16-7c54-4ceb-91ce-6b6564f6719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:23.616214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1329/2673] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:23.626594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.627981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:23.686552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee53d-e3ca-4ea1-9e08-19e56e47b6c5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.690054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13897eb8-b050-4990-8944-cc6e65473df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.690728 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13897eb8-b050-4990-8944-cc6e65473df2 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.691011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13897eb8-b050-4990-8944-cc6e65473df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.691285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13897eb8-b050-4990-8944-cc6e65473df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.699989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13897eb8-b050-4990-8944-cc6e65473df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.701414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13897eb8-b050-4990-8944-cc6e65473df2 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.710391 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1345/2674] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:23.984699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224b16-7c54-4ceb-91ce-6b6564f6719a None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.986062 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-33224b16-7c54-4ceb-91ce-6b6564f6719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:23.997611 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224b16-7c54-4ceb-91ce-6b6564f6719a None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:24.002014 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:24.002874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.003154 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.003505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] PATH_INFO: `/v3/projects/0cdfd9708f3643daa28cf7b9afa4c5c7` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.004687 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdfd9708f3643daa28cf7b9afa4c5c7)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:24.006619 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:24.053933 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdfd9708f3643daa28cf7b9afa4c5c7', 'request_id': 'req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:24.059987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdfd9708f3643daa28cf7b9afa4c5c7', 'request_id': 'req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:24.067584 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdfd9708f3643daa28cf7b9afa4c5c7', 'request_id': 'req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:24.077772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] The token cache is being invalidate because project 0cdfd9708f3643daa28cf7b9afa4c5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:24.078064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:24.078834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-aac23a9d-1bb8-42cf-b17b-7fcd2961e2a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:24.081165 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1330/2675] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:13:23 2021] DELETE /identity/v3/projects/0cdfd9708f3643daa28cf7b9afa4c5c7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:24.087889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f493bd-ed2e-4ae9-ac34-269ad877632e None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.088181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f493bd-ed2e-4ae9-ac34-269ad877632e None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.088460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f493bd-ed2e-4ae9-ac34-269ad877632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.105917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-40f493bd-ed2e-4ae9-ac34-269ad877632e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:24.107123 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-40f493bd-ed2e-4ae9-ac34-269ad877632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:24.162932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1346/2676] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:24.171822 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a452-5a1f-447e-b1fe-6d91b85becb1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.172112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a452-5a1f-447e-b1fe-6d91b85becb1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.172395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a452-5a1f-447e-b1fe-6d91b85becb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.190582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-1596a452-5a1f-447e-b1fe-6d91b85becb1 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:24.192817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-1596a452-5a1f-447e-b1fe-6d91b85becb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:24.200025 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1331/2677] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:24.204069 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f493bd-ed2e-4ae9-ac34-269ad877632e None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:24.213421 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f493bd-ed2e-4ae9-ac34-269ad877632e None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:24.217925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:24.218578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.218862 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.219141 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.219904 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:24.220322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:24.222012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:24.233529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1347/2678] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:13:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:24.238534 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a452-5a1f-447e-b1fe-6d91b85becb1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:24.246861 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a452-5a1f-447e-b1fe-6d91b85becb1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:24.251183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80b052-3cf1-4ced-97bf-b69157737c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:24.251881 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80b052-3cf1-4ced-97bf-b69157737c6d admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.252160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80b052-3cf1-4ced-97bf-b69157737c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.252427 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80b052-3cf1-4ced-97bf-b69157737c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.253106 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80b052-3cf1-4ced-97bf-b69157737c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:24.255999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80b052-3cf1-4ced-97bf-b69157737c6d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:24.280004 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1332/2679] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:24 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:24.284252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:24.293439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af2a6-93a5-44c3-bb4f-8dc609ed9ae4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:24.346883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30c23b-38de-4d67-a1e9-de8a7104b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:24.348170 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30c23b-38de-4d67-a1e9-de8a7104b93d admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.348454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30c23b-38de-4d67-a1e9-de8a7104b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.348724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30c23b-38de-4d67-a1e9-de8a7104b93d admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.349408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30c23b-38de-4d67-a1e9-de8a7104b93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:24.351308 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30c23b-38de-4d67-a1e9-de8a7104b93d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:24.371045 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1348/2680] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:24 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:24.375027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80b052-3cf1-4ced-97bf-b69157737c6d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:24.385252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80b052-3cf1-4ced-97bf-b69157737c6d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:24.391195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196cf8-22cf-460a-a71e-b8c885e5484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:24.391984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196cf8-22cf-460a-a71e-b8c885e5484c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.392330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196cf8-22cf-460a-a71e-b8c885e5484c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.392681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196cf8-22cf-460a-a71e-b8c885e5484c admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.393478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77196cf8-22cf-460a-a71e-b8c885e5484c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:24.395316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77196cf8-22cf-460a-a71e-b8c885e5484c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:24.406802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1333/2681] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:24.411366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30c23b-38de-4d67-a1e9-de8a7104b93d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:24.420791 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30c23b-38de-4d67-a1e9-de8a7104b93d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:24.425722 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad215e5-969a-4dcc-920a-fc8365da3131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:24.426539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad215e5-969a-4dcc-920a-fc8365da3131 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.426831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad215e5-969a-4dcc-920a-fc8365da3131 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.427110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad215e5-969a-4dcc-920a-fc8365da3131 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.427869 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad215e5-969a-4dcc-920a-fc8365da3131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:24.429460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad215e5-969a-4dcc-920a-fc8365da3131 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:24.439070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1349/2682] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:24 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:13:24.443306 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196cf8-22cf-460a-a71e-b8c885e5484c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:24.452315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196cf8-22cf-460a-a71e-b8c885e5484c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:24.457121 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:24.457984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.458263 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.458536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] PATH_INFO: `/v3/projects/6ce504669b154dd7b2cb45a21d8b889b/users/8a85216c17234c099440b2e2c7934755/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.473233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce504669b154dd7b2cb45a21d8b889b, user_id=8a85216c17234c099440b2e2c7934755, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:24.475888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:24.489488 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1334/2683] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:24 2021] PUT /identity/v3/projects/6ce504669b154dd7b2cb45a21d8b889b/users/8a85216c17234c099440b2e2c7934755/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:24.494369 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5915b-b7cc-4250-9021-fe5bb5cd44a2 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.494659 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5915b-b7cc-4250-9021-fe5bb5cd44a2 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.494940 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5915b-b7cc-4250-9021-fe5bb5cd44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.511895 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-3da5915b-b7cc-4250-9021-fe5bb5cd44a2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:24.513054 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-3da5915b-b7cc-4250-9021-fe5bb5cd44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:24.569277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1350/2684] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:24.579152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:24.581323 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:24.635823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816d0c-9d7d-489a-8155-dec386e341c5 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:24.639163 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e012f-4b4a-4426-bc8a-23b79d813e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:24.639819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e012f-4b4a-4426-bc8a-23b79d813e7c service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:24.640102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e012f-4b4a-4426-bc8a-23b79d813e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:24.640372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e012f-4b4a-4426-bc8a-23b79d813e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:24.648926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e012f-4b4a-4426-bc8a-23b79d813e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:24.650349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e012f-4b4a-4426-bc8a-23b79d813e7c service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:24.658912 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1335/2685] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:13:28.621021 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8694-77ef-4f45-a867-ec61590e6fef None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:28.621477 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8694-77ef-4f45-a867-ec61590e6fef None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:28.621581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8694-77ef-4f45-a867-ec61590e6fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:28.658198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-670d8694-77ef-4f45-a867-ec61590e6fef None None] MFA Rules not processed for user `8a85216c17234c099440b2e2c7934755`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:28.659465 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-670d8694-77ef-4f45-a867-ec61590e6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:28.731876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1351/2686] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:28 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:28.736054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e012f-4b4a-4426-bc8a-23b79d813e7c service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:28.751229 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e012f-4b4a-4426-bc8a-23b79d813e7c service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:28.756009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b73b9-5fdb-4af0-af7a-37e5226147b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:28.756866 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b73b9-5fdb-4af0-af7a-37e5226147b3 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:28.757147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b73b9-5fdb-4af0-af7a-37e5226147b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:28.757418 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b73b9-5fdb-4af0-af7a-37e5226147b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:28.758110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b73b9-5fdb-4af0-af7a-37e5226147b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:28.760144 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b73b9-5fdb-4af0-af7a-37e5226147b3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:28.789258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1336/2687] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:28 2021] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:28.793470 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d8694-77ef-4f45-a867-ec61590e6fef None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:28.804476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d8694-77ef-4f45-a867-ec61590e6fef None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:28.864839 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded1108-a152-470f-bacc-6ac5477d0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:28.865529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1108-a152-470f-bacc-6ac5477d0a7d admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:28.865812 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1108-a152-470f-bacc-6ac5477d0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:28.866090 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1108-a152-470f-bacc-6ac5477d0a7d admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:28.866785 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded1108-a152-470f-bacc-6ac5477d0a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:28.868778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded1108-a152-470f-bacc-6ac5477d0a7d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:28.893222 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1352/2688] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:28 2021] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:28.897839 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b73b9-5fdb-4af0-af7a-37e5226147b3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:28.907991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b73b9-5fdb-4af0-af7a-37e5226147b3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:28.913608 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935c131-4328-48ec-bc4e-d29a809c0328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:28.914316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c131-4328-48ec-bc4e-d29a809c0328 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:28.914652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c131-4328-48ec-bc4e-d29a809c0328 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:28.914928 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c131-4328-48ec-bc4e-d29a809c0328 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:28.915887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935c131-4328-48ec-bc4e-d29a809c0328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:28.917634 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935c131-4328-48ec-bc4e-d29a809c0328 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:28.929818 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1337/2689] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:28.934132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded1108-a152-470f-bacc-6ac5477d0a7d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:28.945775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded1108-a152-470f-bacc-6ac5477d0a7d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:28.950568 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f961a8-8c80-4fd5-8009-e32d6d0bc6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:28.951491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f961a8-8c80-4fd5-8009-e32d6d0bc6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:28.951794 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f961a8-8c80-4fd5-8009-e32d6d0bc6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:28.952068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f961a8-8c80-4fd5-8009-e32d6d0bc6e5 admin admin] PATH_INFO: `/v3/projects/eac5e9bf63b64f5981e650ee0a1a9512/users/877b897e6d4940d39aa353eb4daf1704/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:28.968932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f961a8-8c80-4fd5-8009-e32d6d0bc6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac5e9bf63b64f5981e650ee0a1a9512, user_id=877b897e6d4940d39aa353eb4daf1704, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:28.971609 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f961a8-8c80-4fd5-8009-e32d6d0bc6e5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:28.986204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1353/2690] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:28 2021] PUT /identity/v3/projects/eac5e9bf63b64f5981e650ee0a1a9512/users/877b897e6d4940d39aa353eb4daf1704/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:28.991082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935c131-4328-48ec-bc4e-d29a809c0328 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:29.001934 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935c131-4328-48ec-bc4e-d29a809c0328 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:29.077690 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d61884-9fdd-41c1-b8c1-52e3da43c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:29.078367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d61884-9fdd-41c1-b8c1-52e3da43c148 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:29.078651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d61884-9fdd-41c1-b8c1-52e3da43c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:29.078926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d61884-9fdd-41c1-b8c1-52e3da43c148 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:29.079733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d61884-9fdd-41c1-b8c1-52e3da43c148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:29.081961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d61884-9fdd-41c1-b8c1-52e3da43c148 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:29.093244 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1338/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:28 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:13:29.097709 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f961a8-8c80-4fd5-8009-e32d6d0bc6e5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:29.107998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f961a8-8c80-4fd5-8009-e32d6d0bc6e5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:29.112483 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:29.114140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:29.114573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:29.114854 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] PATH_INFO: `/v3/projects/eac5e9bf63b64f5981e650ee0a1a9512/users/877b897e6d4940d39aa353eb4daf1704/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:29.116782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac5e9bf63b64f5981e650ee0a1a9512, user_id=877b897e6d4940d39aa353eb4daf1704, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:29.123003 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:29.131460 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1354/2692] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:29 2021] PUT /identity/v3/projects/eac5e9bf63b64f5981e650ee0a1a9512/users/877b897e6d4940d39aa353eb4daf1704/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:33.825885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732c9a-bb80-4698-89d8-48df26506982 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:33.826378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732c9a-bb80-4698-89d8-48df26506982 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:33.826565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732c9a-bb80-4698-89d8-48df26506982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:33.854054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-f7732c9a-bb80-4698-89d8-48df26506982 None None] MFA Rules not processed for user `877b897e6d4940d39aa353eb4daf1704`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:33.855353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-f7732c9a-bb80-4698-89d8-48df26506982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:33.929907 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1339/2693] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:33 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:33.942273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:33.944030 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:34.002078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0329031-3a91-4d71-87eb-7af02e478dd2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:34.006195 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8eb54ff54264f309aa5949ed8aef453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:34.006853 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:34.007134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:34.007408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:34.064635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:34.066925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:34.076098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1355/2694] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:33 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:13:34.187184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122c87-b178-45b8-a8a0-0347ca0bc8e0 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:34.187477 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122c87-b178-45b8-a8a0-0347ca0bc8e0 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:34.187827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122c87-b178-45b8-a8a0-0347ca0bc8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:34.245640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-e7122c87-b178-45b8-a8a0-0347ca0bc8e0 None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:34.246738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e7122c87-b178-45b8-a8a0-0347ca0bc8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:34.313691 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1340/2695] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 04:13:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:34.361550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:34.363006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:34.447787 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64713c-1cfb-4c36-b9f1-db5465939e80 service glance] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:34.452478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:34.453119 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:34.453401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:34.453676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:34.461835 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:34.463409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:34.470719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1356/2696] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 04:13:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:37.086827 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7122c87-b178-45b8-a8a0-0347ca0bc8e0 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:37.092998 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-e7122c87-b178-45b8-a8a0-0347ca0bc8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:37.196002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7122c87-b178-45b8-a8a0-0347ca0bc8e0 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:37.196002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:37.196002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:37.196002 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:37.196429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:37.201843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:37.305122 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:37.318351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:37.350202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1341/2697] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:13:40.997140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:40.999279 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:41.024535 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90f98-06e7-456a-9f03-48d1a1b05a72 service swift] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.029580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.030681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.031282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.031737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] PATH_INFO: `/v3/users/faf7da464d4c44db918dd6c5076846e9` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.033462 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf7da464d4c44db918dd6c5076846e9)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.036907 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.117805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf7da464d4c44db918dd6c5076846e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.140539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf7da464d4c44db918dd6c5076846e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.150192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf7da464d4c44db918dd6c5076846e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.151750 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf7da464d4c44db918dd6c5076846e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.171654 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-79c65be0-6cf7-4e9e-8305-7ac7dfb7e638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf7da464d4c44db918dd6c5076846e9'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.182480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1357/2698] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:13:40 2021] DELETE /identity/v3/users/faf7da464d4c44db918dd6c5076846e9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:41.434318 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.447786 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d693-77b6-4325-b043-1ebcaa55bf67 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.513357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.513939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.514223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.514501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] PATH_INFO: `/v3/projects/e20265dc285042d5ab0d2e9237fe9fdf` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.515674 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20265dc285042d5ab0d2e9237fe9fdf)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.517655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.573710 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20265dc285042d5ab0d2e9237fe9fdf', 'request_id': 'req-a503684e-9c48-43cf-a5ac-0299f2e3e46c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.580767 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20265dc285042d5ab0d2e9237fe9fdf', 'request_id': 'req-a503684e-9c48-43cf-a5ac-0299f2e3e46c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.591923 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20265dc285042d5ab0d2e9237fe9fdf', 'request_id': 'req-a503684e-9c48-43cf-a5ac-0299f2e3e46c'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.603199 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] The token cache is being invalidate because project e20265dc285042d5ab0d2e9237fe9fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:41.603490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.604176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-a503684e-9c48-43cf-a5ac-0299f2e3e46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.605942 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1342/2699] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:13:41 2021] DELETE /identity/v3/projects/e20265dc285042d5ab0d2e9237fe9fdf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:41.613921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3dbfe-2290-4b01-93cf-94b169470495 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.614211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3dbfe-2290-4b01-93cf-94b169470495 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.614493 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3dbfe-2290-4b01-93cf-94b169470495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.633487 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6cd3dbfe-2290-4b01-93cf-94b169470495 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:41.634765 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6cd3dbfe-2290-4b01-93cf-94b169470495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:41.695408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1358/2700] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:41.703198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b859a21-d08b-4df6-a49e-a841daa3c7df None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.703496 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b859a21-d08b-4df6-a49e-a841daa3c7df None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.703814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b859a21-d08b-4df6-a49e-a841daa3c7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.726353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-3b859a21-d08b-4df6-a49e-a841daa3c7df None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:41.727595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3b859a21-d08b-4df6-a49e-a841daa3c7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:41.740078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1343/2701] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:41.742972 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3dbfe-2290-4b01-93cf-94b169470495 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.754525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3dbfe-2290-4b01-93cf-94b169470495 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.759152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.759852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.760137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.760420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.761146 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:41.761455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.763053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.779737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1359/2702] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:13:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:41.782603 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b859a21-d08b-4df6-a49e-a841daa3c7df None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.794580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b859a21-d08b-4df6-a49e-a841daa3c7df None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.799102 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f523b-937d-4029-bcdb-5b3fac46a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.799915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f523b-937d-4029-bcdb-5b3fac46a807 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.800235 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f523b-937d-4029-bcdb-5b3fac46a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.800587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f523b-937d-4029-bcdb-5b3fac46a807 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.801282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f523b-937d-4029-bcdb-5b3fac46a807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.803214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f523b-937d-4029-bcdb-5b3fac46a807 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.834507 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1344/2703] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:41 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:41.838878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.850319 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd44b5e-f4b4-4b38-a684-0e821c19aa0b admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.920744 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ae42-e207-458c-89c5-6ad40de8d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.921682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ae42-e207-458c-89c5-6ad40de8d0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.921964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ae42-e207-458c-89c5-6ad40de8d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.922296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ae42-e207-458c-89c5-6ad40de8d0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.923261 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26ae42-e207-458c-89c5-6ad40de8d0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.925464 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26ae42-e207-458c-89c5-6ad40de8d0a2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.949619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1360/2704] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:41 2021] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:41.953814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f523b-937d-4029-bcdb-5b3fac46a807 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.964370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f523b-937d-4029-bcdb-5b3fac46a807 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.971483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccd9a7-1c7a-41f0-accb-3725f1fdc84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.972255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccd9a7-1c7a-41f0-accb-3725f1fdc84c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.972531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccd9a7-1c7a-41f0-accb-3725f1fdc84c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.972799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccd9a7-1c7a-41f0-accb-3725f1fdc84c admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.973560 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccd9a7-1c7a-41f0-accb-3725f1fdc84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.975186 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccd9a7-1c7a-41f0-accb-3725f1fdc84c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.989448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1345/2705] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:41.992652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ae42-e207-458c-89c5-6ad40de8d0a2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.002511 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ae42-e207-458c-89c5-6ad40de8d0a2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.010793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5049bc-5094-4129-9167-a4ed8c034a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.011614 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5049bc-5094-4129-9167-a4ed8c034a57 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.012110 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5049bc-5094-4129-9167-a4ed8c034a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.012452 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5049bc-5094-4129-9167-a4ed8c034a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.013258 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5049bc-5094-4129-9167-a4ed8c034a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.014919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5049bc-5094-4129-9167-a4ed8c034a57 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.030251 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1361/2706] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:41 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:42.031001 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccd9a7-1c7a-41f0-accb-3725f1fdc84c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.042124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccd9a7-1c7a-41f0-accb-3725f1fdc84c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.048443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381562a0-6af8-4408-a3bb-e20ab3f4c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.049468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381562a0-6af8-4408-a3bb-e20ab3f4c490 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.050362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381562a0-6af8-4408-a3bb-e20ab3f4c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.050885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381562a0-6af8-4408-a3bb-e20ab3f4c490 admin admin] PATH_INFO: `/v3/projects/a385e5bf58d34c44b38c59c635589f24/users/37d13a3a341c4ce684399d1b50e6a586/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.068223 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381562a0-6af8-4408-a3bb-e20ab3f4c490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a385e5bf58d34c44b38c59c635589f24, user_id=37d13a3a341c4ce684399d1b50e6a586, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.071080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381562a0-6af8-4408-a3bb-e20ab3f4c490 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.087433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1346/2707] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:42 2021] PUT /identity/v3/projects/a385e5bf58d34c44b38c59c635589f24/users/37d13a3a341c4ce684399d1b50e6a586/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:42.099968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4d5a-b403-4872-8168-f67ad51bec60 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.100305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4d5a-b403-4872-8168-f67ad51bec60 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.100579 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4d5a-b403-4872-8168-f67ad51bec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.128578 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-ca1f4d5a-b403-4872-8168-f67ad51bec60 None None] MFA Rules not processed for user `37d13a3a341c4ce684399d1b50e6a586`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:42.131534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-ca1f4d5a-b403-4872-8168-f67ad51bec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:42.206902 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1362/2708] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:42 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:42.211227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381562a0-6af8-4408-a3bb-e20ab3f4c490 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.285794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381562a0-6af8-4408-a3bb-e20ab3f4c490 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.293198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0ee67-c58b-4bbc-8daa-45538d0f1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.294084 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0ee67-c58b-4bbc-8daa-45538d0f1ebb admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.294513 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0ee67-c58b-4bbc-8daa-45538d0f1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.294952 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0ee67-c58b-4bbc-8daa-45538d0f1ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.295669 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0ee67-c58b-4bbc-8daa-45538d0f1ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.297724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0ee67-c58b-4bbc-8daa-45538d0f1ebb admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.327992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1347/2709] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:42 2021] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:42.332370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4d5a-b403-4872-8168-f67ad51bec60 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.344072 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4d5a-b403-4872-8168-f67ad51bec60 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.412207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6bb0-4e19-4690-8e9b-171a4b72fb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.413006 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6bb0-4e19-4690-8e9b-171a4b72fb39 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.413393 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6bb0-4e19-4690-8e9b-171a4b72fb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.413774 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6bb0-4e19-4690-8e9b-171a4b72fb39 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.414588 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6bb0-4e19-4690-8e9b-171a4b72fb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.416653 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6bb0-4e19-4690-8e9b-171a4b72fb39 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.442214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1363/2710] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:42 2021] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:42.446281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0ee67-c58b-4bbc-8daa-45538d0f1ebb admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.460085 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0ee67-c58b-4bbc-8daa-45538d0f1ebb admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.466069 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4f885-e7df-4459-9016-2ce8acaeba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.466753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f885-e7df-4459-9016-2ce8acaeba8c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.467039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f885-e7df-4459-9016-2ce8acaeba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.467315 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f885-e7df-4459-9016-2ce8acaeba8c admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.468090 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4f885-e7df-4459-9016-2ce8acaeba8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.470114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4f885-e7df-4459-9016-2ce8acaeba8c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.483394 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1348/2711] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:42.487990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6bb0-4e19-4690-8e9b-171a4b72fb39 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.500274 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6bb0-4e19-4690-8e9b-171a4b72fb39 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.505447 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d03903-e44f-4fa5-8493-3336f42292ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.506334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d03903-e44f-4fa5-8493-3336f42292ae admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.506615 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d03903-e44f-4fa5-8493-3336f42292ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.506887 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d03903-e44f-4fa5-8493-3336f42292ae admin admin] PATH_INFO: `/v3/projects/8ec4368c2b874b52a6bf1835a2f49e11/users/db473bc053a5418cbb283c07a78c9f01/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.525762 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d03903-e44f-4fa5-8493-3336f42292ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec4368c2b874b52a6bf1835a2f49e11, user_id=db473bc053a5418cbb283c07a78c9f01, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.528906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d03903-e44f-4fa5-8493-3336f42292ae admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.549102 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1364/2712] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:42 2021] PUT /identity/v3/projects/8ec4368c2b874b52a6bf1835a2f49e11/users/db473bc053a5418cbb283c07a78c9f01/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:13:42.553968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4f885-e7df-4459-9016-2ce8acaeba8c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.564351 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4f885-e7df-4459-9016-2ce8acaeba8c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.630531 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8382d0-9754-4bfa-9939-2e3300f1024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.631385 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8382d0-9754-4bfa-9939-2e3300f1024e admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.631792 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8382d0-9754-4bfa-9939-2e3300f1024e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.632139 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8382d0-9754-4bfa-9939-2e3300f1024e admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.632958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8382d0-9754-4bfa-9939-2e3300f1024e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.634731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8382d0-9754-4bfa-9939-2e3300f1024e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.647370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1349/2713] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:42.651370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d03903-e44f-4fa5-8493-3336f42292ae admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.664876 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d03903-e44f-4fa5-8493-3336f42292ae admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.672159 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0954-ac05-4fd0-a47c-b533b822facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.673214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0954-ac05-4fd0-a47c-b533b822facb admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.673517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0954-ac05-4fd0-a47c-b533b822facb admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.673831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0954-ac05-4fd0-a47c-b533b822facb admin admin] PATH_INFO: `/v3/projects/8ec4368c2b874b52a6bf1835a2f49e11/users/db473bc053a5418cbb283c07a78c9f01/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.677935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0954-ac05-4fd0-a47c-b533b822facb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec4368c2b874b52a6bf1835a2f49e11, user_id=db473bc053a5418cbb283c07a78c9f01, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.683361 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0954-ac05-4fd0-a47c-b533b822facb admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.695634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1365/2714] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:42 2021] PUT /identity/v3/projects/8ec4368c2b874b52a6bf1835a2f49e11/users/db473bc053a5418cbb283c07a78c9f01/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:13:42.707505 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ff95b-d4b3-4086-b688-a4fd20e1cae1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.708179 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ff95b-d4b3-4086-b688-a4fd20e1cae1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.708533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ff95b-d4b3-4086-b688-a4fd20e1cae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.740511 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-299ff95b-d4b3-4086-b688-a4fd20e1cae1 None None] MFA Rules not processed for user `db473bc053a5418cbb283c07a78c9f01`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:42.741798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-299ff95b-d4b3-4086-b688-a4fd20e1cae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:42.820812 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1350/2715] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:42 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:42.828573 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0954-ac05-4fd0-a47c-b533b822facb admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:42.896585 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0954-ac05-4fd0-a47c-b533b822facb admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.901473 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.902360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.902641 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.902916 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] PATH_INFO: `/v3/users/37d13a3a341c4ce684399d1b50e6a586` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.904137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d13a3a341c4ce684399d1b50e6a586)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.906049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.961980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d13a3a341c4ce684399d1b50e6a586'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:42.976550 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d13a3a341c4ce684399d1b50e6a586'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:42.984014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d13a3a341c4ce684399d1b50e6a586'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:42.984754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d13a3a341c4ce684399d1b50e6a586'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:42.993763 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d13a3a341c4ce684399d1b50e6a586'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.004892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1366/2716] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:13:42 2021] DELETE /identity/v3/users/37d13a3a341c4ce684399d1b50e6a586 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:43.006750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ce5c-4c82-4e79-ad1d-05bcff088d9c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.007098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ce5c-4c82-4e79-ad1d-05bcff088d9c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.007441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ce5c-4c82-4e79-ad1d-05bcff088d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.028263 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9149ce5c-4c82-4e79-ad1d-05bcff088d9c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:43.029567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9149ce5c-4c82-4e79-ad1d-05bcff088d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:43.094597 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1351/2717] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:43.105508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.106930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:43.172224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa961f35-d484-4536-bd6a-209537b28350 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.176218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41528d6d-fcc2-4a4c-bfa8-41c65e169673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.177047 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528d6d-fcc2-4a4c-bfa8-41c65e169673 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.177397 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528d6d-fcc2-4a4c-bfa8-41c65e169673 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.177737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528d6d-fcc2-4a4c-bfa8-41c65e169673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.193957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41528d6d-fcc2-4a4c-bfa8-41c65e169673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.198706 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41528d6d-fcc2-4a4c-bfa8-41c65e169673 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.213083 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1367/2718] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:43.531752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149ce5c-4c82-4e79-ad1d-05bcff088d9c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.535155 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9149ce5c-4c82-4e79-ad1d-05bcff088d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:43.555665 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149ce5c-4c82-4e79-ad1d-05bcff088d9c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.561053 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.562078 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.562378 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.562656 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] PATH_INFO: `/v3/projects/a385e5bf58d34c44b38c59c635589f24` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.565227 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a385e5bf58d34c44b38c59c635589f24)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.567961 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.623475 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a385e5bf58d34c44b38c59c635589f24', 'request_id': 'req-14d1a325-6b95-48b5-9bf9-7e87ebe55861'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.630582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a385e5bf58d34c44b38c59c635589f24', 'request_id': 'req-14d1a325-6b95-48b5-9bf9-7e87ebe55861'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.639499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a385e5bf58d34c44b38c59c635589f24', 'request_id': 'req-14d1a325-6b95-48b5-9bf9-7e87ebe55861'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.650782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] The token cache is being invalidate because project a385e5bf58d34c44b38c59c635589f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:43.651064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.651692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-14d1a325-6b95-48b5-9bf9-7e87ebe55861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.653565 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1352/2719] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:13:43 2021] DELETE /identity/v3/projects/a385e5bf58d34c44b38c59c635589f24 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:43.657422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41528d6d-fcc2-4a4c-bfa8-41c65e169673 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.667820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41528d6d-fcc2-4a4c-bfa8-41c65e169673 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.728651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.729524 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.729807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.730093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] PATH_INFO: `/v3/users/db473bc053a5418cbb283c07a78c9f01` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.731285 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=db473bc053a5418cbb283c07a78c9f01)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.733619 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.779077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db473bc053a5418cbb283c07a78c9f01'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.791286 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db473bc053a5418cbb283c07a78c9f01'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.797892 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db473bc053a5418cbb283c07a78c9f01'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.798569 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db473bc053a5418cbb283c07a78c9f01'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.805918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db473bc053a5418cbb283c07a78c9f01'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:43.812036 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1368/2720] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:13:43 2021] DELETE /identity/v3/users/db473bc053a5418cbb283c07a78c9f01 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:44.090531 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.091125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec4bb4-325f-491d-a749-c17a53a4b5a7 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.091125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec4bb4-325f-491d-a749-c17a53a4b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.091301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec4bb4-325f-491d-a749-c17a53a4b5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.092273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:44.123057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-afec4bb4-325f-491d-a749-c17a53a4b5a7 None None] MFA Rules not processed for user `8a85216c17234c099440b2e2c7934755`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:44.123057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-afec4bb4-325f-491d-a749-c17a53a4b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:44.158401 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d66ac-b313-426a-bbec-21569f6eb3fe admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.162834 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.163791 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.164075 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.164518 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] PATH_INFO: `/v3/projects/8ec4368c2b874b52a6bf1835a2f49e11` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.165799 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec4368c2b874b52a6bf1835a2f49e11)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.167738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.178234 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1353/2721] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:44 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:44.216268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec4368c2b874b52a6bf1835a2f49e11', 'request_id': 'req-df70f19f-8d71-46ae-9496-ebf4b0842ed4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:44.222792 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec4368c2b874b52a6bf1835a2f49e11', 'request_id': 'req-df70f19f-8d71-46ae-9496-ebf4b0842ed4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:44.230620 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec4368c2b874b52a6bf1835a2f49e11', 'request_id': 'req-df70f19f-8d71-46ae-9496-ebf4b0842ed4'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:44.242060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] The token cache is being invalidate because project 8ec4368c2b874b52a6bf1835a2f49e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:44.242348 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:44.242981 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-df70f19f-8d71-46ae-9496-ebf4b0842ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:44.244549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1369/2722] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:13:44 2021] DELETE /identity/v3/projects/8ec4368c2b874b52a6bf1835a2f49e11 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:13:44.250119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cbc3f-bb93-4f34-bc44-696e8ea2fe66 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.250415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cbc3f-bb93-4f34-bc44-696e8ea2fe66 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.250692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cbc3f-bb93-4f34-bc44-696e8ea2fe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.268630 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-623cbc3f-bb93-4f34-bc44-696e8ea2fe66 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:44.269795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-623cbc3f-bb93-4f34-bc44-696e8ea2fe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:44.328701 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1354/2723] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:44.337215 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62cba4-f9e0-45bc-adaa-7560b2778318 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.337507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62cba4-f9e0-45bc-adaa-7560b2778318 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.337790 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62cba4-f9e0-45bc-adaa-7560b2778318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.355759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-fb62cba4-f9e0-45bc-adaa-7560b2778318 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:44.356941 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fb62cba4-f9e0-45bc-adaa-7560b2778318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:44.365237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1370/2724] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:44.369407 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cbc3f-bb93-4f34-bc44-696e8ea2fe66 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.378904 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cbc3f-bb93-4f34-bc44-696e8ea2fe66 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.383337 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.384153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.384441 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.384720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.385452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:44.385760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.387358 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.402825 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1355/2725] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:13:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:44.403973 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62cba4-f9e0-45bc-adaa-7560b2778318 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.413140 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62cba4-f9e0-45bc-adaa-7560b2778318 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.417644 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685809f4-93a8-416f-965d-b235521a0083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.418302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685809f4-93a8-416f-965d-b235521a0083 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.418581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685809f4-93a8-416f-965d-b235521a0083 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.418858 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685809f4-93a8-416f-965d-b235521a0083 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.419541 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685809f4-93a8-416f-965d-b235521a0083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.421468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685809f4-93a8-416f-965d-b235521a0083 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.447352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1371/2726] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:44 2021] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:44.451745 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.462434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4cbba-46c6-4030-b036-ebd915497d18 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.518073 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858eb1-74d5-4949-b4e6-6439eb9350d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.519295 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858eb1-74d5-4949-b4e6-6439eb9350d9 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.519575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858eb1-74d5-4949-b4e6-6439eb9350d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.519887 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858eb1-74d5-4949-b4e6-6439eb9350d9 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.520572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e858eb1-74d5-4949-b4e6-6439eb9350d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.522502 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e858eb1-74d5-4949-b4e6-6439eb9350d9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.545956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1356/2727] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:44 2021] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:44.547115 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685809f4-93a8-416f-965d-b235521a0083 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.557935 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685809f4-93a8-416f-965d-b235521a0083 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.562542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c8a5-a051-400f-9d5e-bba2e025b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.563207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c8a5-a051-400f-9d5e-bba2e025b9bf admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.563491 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c8a5-a051-400f-9d5e-bba2e025b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.563812 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c8a5-a051-400f-9d5e-bba2e025b9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.564536 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c8a5-a051-400f-9d5e-bba2e025b9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.566712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c8a5-a051-400f-9d5e-bba2e025b9bf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.577400 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1372/2728] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:44.581180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858eb1-74d5-4949-b4e6-6439eb9350d9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.590298 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858eb1-74d5-4949-b4e6-6439eb9350d9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.594658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22428b8e-b0f3-4f65-9660-d9670bfeebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.595319 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428b8e-b0f3-4f65-9660-d9670bfeebe4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.595604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428b8e-b0f3-4f65-9660-d9670bfeebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.595914 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428b8e-b0f3-4f65-9660-d9670bfeebe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.597258 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22428b8e-b0f3-4f65-9660-d9670bfeebe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.598848 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22428b8e-b0f3-4f65-9660-d9670bfeebe4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.609100 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1357/2729] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:44.613770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c8a5-a051-400f-9d5e-bba2e025b9bf admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.622793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c8a5-a051-400f-9d5e-bba2e025b9bf admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.627386 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e78e80-b56a-4b72-84a5-f9fa569d1013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.628545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e78e80-b56a-4b72-84a5-f9fa569d1013 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.628747 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e78e80-b56a-4b72-84a5-f9fa569d1013 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.629022 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e78e80-b56a-4b72-84a5-f9fa569d1013 admin admin] PATH_INFO: `/v3/projects/53a9adb479a643d98dd800aa84efdf5c/users/149274a366234a27b5d0657f6b6a47f7/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.643561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e78e80-b56a-4b72-84a5-f9fa569d1013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a9adb479a643d98dd800aa84efdf5c, user_id=149274a366234a27b5d0657f6b6a47f7, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.646407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e78e80-b56a-4b72-84a5-f9fa569d1013 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.660693 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1373/2730] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:44 2021] PUT /identity/v3/projects/53a9adb479a643d98dd800aa84efdf5c/users/149274a366234a27b5d0657f6b6a47f7/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:44.671809 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9bf2c-567c-4fbe-8eb1-d0ce2eaf4cd1 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.672099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9bf2c-567c-4fbe-8eb1-d0ce2eaf4cd1 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.672374 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9bf2c-567c-4fbe-8eb1-d0ce2eaf4cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.699326 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-c4d9bf2c-567c-4fbe-8eb1-d0ce2eaf4cd1 None None] MFA Rules not processed for user `149274a366234a27b5d0657f6b6a47f7`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:44.700532 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c4d9bf2c-567c-4fbe-8eb1-d0ce2eaf4cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:44.789176 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1358/2731] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:44 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:44.793476 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e78e80-b56a-4b72-84a5-f9fa569d1013 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.856331 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e78e80-b56a-4b72-84a5-f9fa569d1013 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.861122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b170f-daae-44b9-af74-0b2b7b89f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.861777 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b170f-daae-44b9-af74-0b2b7b89f66c admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.862060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b170f-daae-44b9-af74-0b2b7b89f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.862370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b170f-daae-44b9-af74-0b2b7b89f66c admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.863154 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b170f-daae-44b9-af74-0b2b7b89f66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.865059 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b170f-daae-44b9-af74-0b2b7b89f66c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.893602 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1374/2732] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:44 2021] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:44.895016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9bf2c-567c-4fbe-8eb1-d0ce2eaf4cd1 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:44.905325 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9bf2c-567c-4fbe-8eb1-d0ce2eaf4cd1 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:44.963362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107967-31b5-495e-9520-9e1a73061096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:44.964064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107967-31b5-495e-9520-9e1a73061096 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:44.964344 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107967-31b5-495e-9520-9e1a73061096 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:44.964613 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107967-31b5-495e-9520-9e1a73061096 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:44.965369 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107967-31b5-495e-9520-9e1a73061096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:44.967459 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107967-31b5-495e-9520-9e1a73061096 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:44.991152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1359/2733] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:44 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:44.992478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b170f-daae-44b9-af74-0b2b7b89f66c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:45.003773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b170f-daae-44b9-af74-0b2b7b89f66c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:45.008283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ab2c-e8d5-41cb-a5d7-338dc4804115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:45.008983 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ab2c-e8d5-41cb-a5d7-338dc4804115 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.009268 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ab2c-e8d5-41cb-a5d7-338dc4804115 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.009545 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ab2c-e8d5-41cb-a5d7-338dc4804115 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.010264 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069ab2c-e8d5-41cb-a5d7-338dc4804115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:45.011889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069ab2c-e8d5-41cb-a5d7-338dc4804115 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:45.022688 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1375/2734] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:45.027007 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107967-31b5-495e-9520-9e1a73061096 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:45.037005 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107967-31b5-495e-9520-9e1a73061096 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:45.041478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a11e9-7758-4e64-b075-94c6947dfcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:45.042349 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a11e9-7758-4e64-b075-94c6947dfcd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.042614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a11e9-7758-4e64-b075-94c6947dfcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.042892 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a11e9-7758-4e64-b075-94c6947dfcd9 admin admin] PATH_INFO: `/v3/projects/823efd742c5c41e4b1244f135f7b1eeb/users/a0bf97035e85426aa456618f3f4fa88d/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.059999 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a11e9-7758-4e64-b075-94c6947dfcd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823efd742c5c41e4b1244f135f7b1eeb, user_id=a0bf97035e85426aa456618f3f4fa88d, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:45.062638 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a11e9-7758-4e64-b075-94c6947dfcd9 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:45.076340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1360/2735] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:45 2021] PUT /identity/v3/projects/823efd742c5c41e4b1244f135f7b1eeb/users/a0bf97035e85426aa456618f3f4fa88d/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:13:45.080708 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ab2c-e8d5-41cb-a5d7-338dc4804115 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:45.090751 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ab2c-e8d5-41cb-a5d7-338dc4804115 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:45.148921 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ec213-f2e5-443e-b072-e48f77721a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:45.149584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec213-f2e5-443e-b072-e48f77721a9f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.149864 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec213-f2e5-443e-b072-e48f77721a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.150142 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec213-f2e5-443e-b072-e48f77721a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.150852 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ec213-f2e5-443e-b072-e48f77721a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:45.152469 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ec213-f2e5-443e-b072-e48f77721a9f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:45.166355 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1376/2736] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:45 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:45.168126 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a11e9-7758-4e64-b075-94c6947dfcd9 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:45.178616 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a11e9-7758-4e64-b075-94c6947dfcd9 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:45.183879 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:45.184925 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.185211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.185485 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] PATH_INFO: `/v3/projects/823efd742c5c41e4b1244f135f7b1eeb/users/a0bf97035e85426aa456618f3f4fa88d/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.187433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=823efd742c5c41e4b1244f135f7b1eeb, user_id=a0bf97035e85426aa456618f3f4fa88d, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:45.190170 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:45.201588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1361/2737] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:45 2021] PUT /identity/v3/projects/823efd742c5c41e4b1244f135f7b1eeb/users/a0bf97035e85426aa456618f3f4fa88d/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:13:45.211408 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437d0f9-300a-4bc7-a476-5c7d3f60494b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.211800 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437d0f9-300a-4bc7-a476-5c7d3f60494b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.212148 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437d0f9-300a-4bc7-a476-5c7d3f60494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.238272 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2437d0f9-300a-4bc7-a476-5c7d3f60494b None None] MFA Rules not processed for user `a0bf97035e85426aa456618f3f4fa88d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:45.239534 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2437d0f9-300a-4bc7-a476-5c7d3f60494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:45.308415 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1377/2738] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:45 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:45.319783 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:45.321473 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:45.376384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e744f-1cdd-49bc-9d6a-1526918a96ae admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:45.379807 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49015d25-3807-47e6-8ac8-3b4498e0e841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:45.380442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015d25-3807-47e6-8ac8-3b4498e0e841 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.380718 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015d25-3807-47e6-8ac8-3b4498e0e841 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.380987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015d25-3807-47e6-8ac8-3b4498e0e841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.389570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49015d25-3807-47e6-8ac8-3b4498e0e841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:45.390984 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49015d25-3807-47e6-8ac8-3b4498e0e841 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:45.399974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1362/2739] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:45 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:13:45.466726 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437d0f9-300a-4bc7-a476-5c7d3f60494b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:45.476283 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437d0f9-300a-4bc7-a476-5c7d3f60494b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:45.479731 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:45.480380 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.480712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.480988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.536859 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:45.538320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:45.546548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1378/2740] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:45 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:45.980046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c2260-fb5f-47f2-a3e8-b493ea7e2940 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.980540 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c2260-fb5f-47f2-a3e8-b493ea7e2940 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.980623 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c2260-fb5f-47f2-a3e8-b493ea7e2940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.998729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-5c1c2260-fb5f-47f2-a3e8-b493ea7e2940 None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:45.999932 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5c1c2260-fb5f-47f2-a3e8-b493ea7e2940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:46.054130 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1363/2741] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 04:13:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:46.067657 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:46.069017 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:46.137778 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfef5f-5f33-4a1b-a0b3-0fe9db1c24bd service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:46.142827 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b853930-5eee-4869-9158-ade7bcc86d77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:46.143553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853930-5eee-4869-9158-ade7bcc86d77 service swift] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:46.143553 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853930-5eee-4869-9158-ade7bcc86d77 service swift] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:46.144245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853930-5eee-4869-9158-ade7bcc86d77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:46.151932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b853930-5eee-4869-9158-ade7bcc86d77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:46.153523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b853930-5eee-4869-9158-ade7bcc86d77 service swift] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:46.162120 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1379/2742] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 04:13:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:55.904675 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c2260-fb5f-47f2-a3e8-b493ea7e2940 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:55.966922 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c2260-fb5f-47f2-a3e8-b493ea7e2940 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:55.971542 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:55.972623 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:55.973610 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:55.974594 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] PATH_INFO: `/v3/users/149274a366234a27b5d0657f6b6a47f7` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:55.976033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149274a366234a27b5d0657f6b6a47f7)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:55.978124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:56.028885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149274a366234a27b5d0657f6b6a47f7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.041332 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149274a366234a27b5d0657f6b6a47f7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.041997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149274a366234a27b5d0657f6b6a47f7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.049353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149274a366234a27b5d0657f6b6a47f7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.050051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149274a366234a27b5d0657f6b6a47f7'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.063775 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1364/2743] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:13:55 2021] DELETE /identity/v3/users/149274a366234a27b5d0657f6b6a47f7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:56.068571 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263eb60-526a-4ae6-96db-593c62cc2594 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:56.069074 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263eb60-526a-4ae6-96db-593c62cc2594 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:56.069167 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263eb60-526a-4ae6-96db-593c62cc2594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:56.088903 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-5263eb60-526a-4ae6-96db-593c62cc2594 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:56.090078 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5263eb60-526a-4ae6-96db-593c62cc2594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:56.173420 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1380/2744] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:56.184420 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:56.185773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:56.244041 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc56b0-c629-4030-b3e9-77822fe36008 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:56.247804 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516a8d1-320c-441d-8147-9ab47869c25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:56.248440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a8d1-320c-441d-8147-9ab47869c25e service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:56.248717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a8d1-320c-441d-8147-9ab47869c25e service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:56.248986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516a8d1-320c-441d-8147-9ab47869c25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:56.257920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516a8d1-320c-441d-8147-9ab47869c25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:56.259335 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516a8d1-320c-441d-8147-9ab47869c25e service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:56.268202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1365/2745] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:56.562112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263eb60-526a-4ae6-96db-593c62cc2594 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:56.564175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-5263eb60-526a-4ae6-96db-593c62cc2594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:56.584243 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263eb60-526a-4ae6-96db-593c62cc2594 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:56.592556 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:56.593432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:56.593711 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:56.593988 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] PATH_INFO: `/v3/projects/53a9adb479a643d98dd800aa84efdf5c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:56.595150 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a9adb479a643d98dd800aa84efdf5c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:56.597345 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:56.666489 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a9adb479a643d98dd800aa84efdf5c', 'request_id': 'req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.674320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a9adb479a643d98dd800aa84efdf5c', 'request_id': 'req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.684383 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a9adb479a643d98dd800aa84efdf5c', 'request_id': 'req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.701666 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] The token cache is being invalidate because project 53a9adb479a643d98dd800aa84efdf5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:56.702098 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.702761 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.704500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1381/2746] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:13:56 2021] DELETE /identity/v3/projects/53a9adb479a643d98dd800aa84efdf5c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:56.708360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516a8d1-320c-441d-8147-9ab47869c25e service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:56.717903 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516a8d1-320c-441d-8147-9ab47869c25e service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:56.782005 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:56.782983 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:56.783330 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:56.783678 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] PATH_INFO: `/v3/users/a0bf97035e85426aa456618f3f4fa88d` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:56.784944 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0bf97035e85426aa456618f3f4fa88d)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:56.787459 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:56.833012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0bf97035e85426aa456618f3f4fa88d'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.846490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0bf97035e85426aa456618f3f4fa88d'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.847402 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0bf97035e85426aa456618f3f4fa88d'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.856621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0bf97035e85426aa456618f3f4fa88d'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.857341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-117acc9f-73ca-4423-b927-88597117c36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0bf97035e85426aa456618f3f4fa88d'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:56.871220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1366/2747] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:13:56 2021] DELETE /identity/v3/users/a0bf97035e85426aa456618f3f4fa88d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:57.195959 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.197333 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:57.209822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b564b1d-aa0f-49e2-9763-ca74ecb69c6a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:57.281107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:57.281979 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.282252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.282523 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] PATH_INFO: `/v3/projects/823efd742c5c41e4b1244f135f7b1eeb` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.284009 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=823efd742c5c41e4b1244f135f7b1eeb)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:57.287481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:57.332207 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823efd742c5c41e4b1244f135f7b1eeb', 'request_id': 'req-f97167c8-9e05-4a05-9615-c917f8191e2e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:57.338929 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823efd742c5c41e4b1244f135f7b1eeb', 'request_id': 'req-f97167c8-9e05-4a05-9615-c917f8191e2e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:57.346088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823efd742c5c41e4b1244f135f7b1eeb', 'request_id': 'req-f97167c8-9e05-4a05-9615-c917f8191e2e'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:57.357088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] The token cache is being invalidate because project 823efd742c5c41e4b1244f135f7b1eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:57.357370 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:57.358311 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f97167c8-9e05-4a05-9615-c917f8191e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:57.359830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1382/2748] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:13:57 2021] DELETE /identity/v3/projects/823efd742c5c41e4b1244f135f7b1eeb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:57.365551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba56cf-be67-452d-b380-c59da2bb2d8e None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.366052 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba56cf-be67-452d-b380-c59da2bb2d8e None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.366152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba56cf-be67-452d-b380-c59da2bb2d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.385284 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-5aba56cf-be67-452d-b380-c59da2bb2d8e None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:57.386814 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5aba56cf-be67-452d-b380-c59da2bb2d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:57.445468 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1367/2749] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:57.453347 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2489e6-f708-420f-8d06-9b7c9784f1f4 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.453712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2489e6-f708-420f-8d06-9b7c9784f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.453986 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2489e6-f708-420f-8d06-9b7c9784f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.473926 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-2e2489e6-f708-420f-8d06-9b7c9784f1f4 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:57.475221 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-2e2489e6-f708-420f-8d06-9b7c9784f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:57.483088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1383/2750] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:57.487121 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba56cf-be67-452d-b380-c59da2bb2d8e None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.497220 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba56cf-be67-452d-b380-c59da2bb2d8e None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:57.501558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:57.502214 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.502501 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.502772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.503487 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:57.503828 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:57.506010 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:57.517422 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1368/2751] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:13:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:57.522381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2489e6-f708-420f-8d06-9b7c9784f1f4 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.530848 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2489e6-f708-420f-8d06-9b7c9784f1f4 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:57.535240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356adc6-d6e3-4371-9a1c-e7b40da14abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:57.535998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356adc6-d6e3-4371-9a1c-e7b40da14abf admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.536410 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356adc6-d6e3-4371-9a1c-e7b40da14abf admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.536685 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356adc6-d6e3-4371-9a1c-e7b40da14abf admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.537405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356adc6-d6e3-4371-9a1c-e7b40da14abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:57.539287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356adc6-d6e3-4371-9a1c-e7b40da14abf admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:57.567429 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1384/2752] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:57 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:57.571658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.581339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23038-0518-4f00-a9bc-c451adbf9d3c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:57.635939 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb6ece-3546-468f-9d5a-1f0894ed99c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:57.636529 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb6ece-3546-468f-9d5a-1f0894ed99c0 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.636823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb6ece-3546-468f-9d5a-1f0894ed99c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.637101 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb6ece-3546-468f-9d5a-1f0894ed99c0 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.637789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb6ece-3546-468f-9d5a-1f0894ed99c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:57.639740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb6ece-3546-468f-9d5a-1f0894ed99c0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:57.660556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1369/2753] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:57 2021] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:57.665591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356adc6-d6e3-4371-9a1c-e7b40da14abf admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.675228 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356adc6-d6e3-4371-9a1c-e7b40da14abf admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:57.680133 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b0379-dd23-417f-9a5d-58c7e7893217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:57.680796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0379-dd23-417f-9a5d-58c7e7893217 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.681076 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0379-dd23-417f-9a5d-58c7e7893217 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.681352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0379-dd23-417f-9a5d-58c7e7893217 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.682068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b0379-dd23-417f-9a5d-58c7e7893217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:57.683661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b0379-dd23-417f-9a5d-58c7e7893217 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:57.694197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1385/2754] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:57 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:57.698157 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb6ece-3546-468f-9d5a-1f0894ed99c0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.707681 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb6ece-3546-468f-9d5a-1f0894ed99c0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:57.712262 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22930d75-d5e1-4f6f-aac9-102285b003d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:57.712921 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930d75-d5e1-4f6f-aac9-102285b003d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.713203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930d75-d5e1-4f6f-aac9-102285b003d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.713481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930d75-d5e1-4f6f-aac9-102285b003d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.714201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22930d75-d5e1-4f6f-aac9-102285b003d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:57.715832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22930d75-d5e1-4f6f-aac9-102285b003d4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:57.727494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1370/2755] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:13:57.731139 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b0379-dd23-417f-9a5d-58c7e7893217 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.741041 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b0379-dd23-417f-9a5d-58c7e7893217 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:57.745358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56489b02-3247-4ab8-8385-47091c53ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:57.746271 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56489b02-3247-4ab8-8385-47091c53ea5f admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.746549 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56489b02-3247-4ab8-8385-47091c53ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.746822 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56489b02-3247-4ab8-8385-47091c53ea5f admin admin] PATH_INFO: `/v3/projects/4c198ff0c34440cbae4402761380b342/users/d1fbae7363f94b4a979c72bae3d13a47/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.762461 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56489b02-3247-4ab8-8385-47091c53ea5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c198ff0c34440cbae4402761380b342, user_id=d1fbae7363f94b4a979c72bae3d13a47, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:57.765223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56489b02-3247-4ab8-8385-47091c53ea5f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:57.778863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1386/2756] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:57 2021] PUT /identity/v3/projects/4c198ff0c34440cbae4402761380b342/users/d1fbae7363f94b4a979c72bae3d13a47/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:57.790092 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25473402-583e-405d-b922-eca45f6c7f1c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.790457 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25473402-583e-405d-b922-eca45f6c7f1c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.790916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25473402-583e-405d-b922-eca45f6c7f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.818370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-25473402-583e-405d-b922-eca45f6c7f1c None None] MFA Rules not processed for user `d1fbae7363f94b4a979c72bae3d13a47`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:57.819550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-25473402-583e-405d-b922-eca45f6c7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:57.883077 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1371/2757] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:57 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:57.887890 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56489b02-3247-4ab8-8385-47091c53ea5f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.947208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56489b02-3247-4ab8-8385-47091c53ea5f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:57.951671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fb0f5-0f24-4099-8054-e6c54c0d0f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:57.952358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fb0f5-0f24-4099-8054-e6c54c0d0f9e admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:57.952642 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fb0f5-0f24-4099-8054-e6c54c0d0f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:57.952919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fb0f5-0f24-4099-8054-e6c54c0d0f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:57.953597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fb0f5-0f24-4099-8054-e6c54c0d0f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:57.955478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fb0f5-0f24-4099-8054-e6c54c0d0f9e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:57.981088 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1387/2758] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:13:57 2021] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:57.985558 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25473402-583e-405d-b922-eca45f6c7f1c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:57.995886 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25473402-583e-405d-b922-eca45f6c7f1c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:58.048795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91c8ec-bd50-40c7-99a8-109cbee51d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:58.049451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c8ec-bd50-40c7-99a8-109cbee51d5a admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:58.049897 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c8ec-bd50-40c7-99a8-109cbee51d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:58.050194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c8ec-bd50-40c7-99a8-109cbee51d5a admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:58.050952 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91c8ec-bd50-40c7-99a8-109cbee51d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:58.053334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91c8ec-bd50-40c7-99a8-109cbee51d5a admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:58.071985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1372/2759] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:13:57 2021] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:58.075866 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fb0f5-0f24-4099-8054-e6c54c0d0f9e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:58.086231 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fb0f5-0f24-4099-8054-e6c54c0d0f9e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:58.090494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639ecc4-a38e-4654-8042-ee7b64ca23d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:58.091145 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639ecc4-a38e-4654-8042-ee7b64ca23d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:58.091425 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639ecc4-a38e-4654-8042-ee7b64ca23d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:58.091698 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639ecc4-a38e-4654-8042-ee7b64ca23d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:58.092432 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639ecc4-a38e-4654-8042-ee7b64ca23d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:58.094025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639ecc4-a38e-4654-8042-ee7b64ca23d4 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:58.104378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1388/2760] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:58.108499 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91c8ec-bd50-40c7-99a8-109cbee51d5a admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:58.117766 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91c8ec-bd50-40c7-99a8-109cbee51d5a admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:58.122273 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a77b5e-1fe5-4718-a983-352ebad2f740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:58.123151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77b5e-1fe5-4718-a983-352ebad2f740 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:58.123434 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77b5e-1fe5-4718-a983-352ebad2f740 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:58.123751 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77b5e-1fe5-4718-a983-352ebad2f740 admin admin] PATH_INFO: `/v3/projects/e4a27b70ab02469a9de5ac3928b9556b/users/3ea77177ce7c4fba9fcabb0c2db8ed13/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:58.138429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a77b5e-1fe5-4718-a983-352ebad2f740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a27b70ab02469a9de5ac3928b9556b, user_id=3ea77177ce7c4fba9fcabb0c2db8ed13, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:58.141058 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a77b5e-1fe5-4718-a983-352ebad2f740 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:58.154316 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1373/2761] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:58 2021] PUT /identity/v3/projects/e4a27b70ab02469a9de5ac3928b9556b/users/3ea77177ce7c4fba9fcabb0c2db8ed13/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:13:58.158152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639ecc4-a38e-4654-8042-ee7b64ca23d4 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:58.167883 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639ecc4-a38e-4654-8042-ee7b64ca23d4 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:58.221842 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f902e8a-6ba3-48a6-b1ce-63ea23ef7346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:58.222502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f902e8a-6ba3-48a6-b1ce-63ea23ef7346 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:58.222782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f902e8a-6ba3-48a6-b1ce-63ea23ef7346 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:58.223125 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f902e8a-6ba3-48a6-b1ce-63ea23ef7346 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:58.224070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f902e8a-6ba3-48a6-b1ce-63ea23ef7346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:58.225651 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f902e8a-6ba3-48a6-b1ce-63ea23ef7346 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:58.235197 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1389/2762] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:13:58.239357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a77b5e-1fe5-4718-a983-352ebad2f740 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:58.249063 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a77b5e-1fe5-4718-a983-352ebad2f740 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:58.253478 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:58.254846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:58.255124 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:58.255395 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] PATH_INFO: `/v3/projects/e4a27b70ab02469a9de5ac3928b9556b/users/3ea77177ce7c4fba9fcabb0c2db8ed13/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:58.257287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a27b70ab02469a9de5ac3928b9556b, user_id=3ea77177ce7c4fba9fcabb0c2db8ed13, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:58.259924 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:58.269759 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1374/2763] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:13:58 2021] PUT /identity/v3/projects/e4a27b70ab02469a9de5ac3928b9556b/users/3ea77177ce7c4fba9fcabb0c2db8ed13/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:58.279459 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca3a7-5b76-4e53-a97f-a9d68f015d00 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:58.279788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca3a7-5b76-4e53-a97f-a9d68f015d00 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:58.280073 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca3a7-5b76-4e53-a97f-a9d68f015d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:58.308759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-826ca3a7-5b76-4e53-a97f-a9d68f015d00 None None] MFA Rules not processed for user `3ea77177ce7c4fba9fcabb0c2db8ed13`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:58.309925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-826ca3a7-5b76-4e53-a97f-a9d68f015d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:58.375226 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1390/2764] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:13:58 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:58.385195 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:58.386841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:58.450482 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2ea69-68e8-4adc-9831-b67fc46ccbaa admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:58.454017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:58.454680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:58.454960 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:58.455246 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:58.512357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:58.513789 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:58.523187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1375/2765] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:13:58 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:04.154307 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca3a7-5b76-4e53-a97f-a9d68f015d00 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:04.155759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-826ca3a7-5b76-4e53-a97f-a9d68f015d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:04.167113 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca3a7-5b76-4e53-a97f-a9d68f015d00 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:04.170520 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c6b93-3405-4783-a204-1b02f5e88039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:04.171164 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6b93-3405-4783-a204-1b02f5e88039 service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:04.171446 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6b93-3405-4783-a204-1b02f5e88039 service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:04.171755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6b93-3405-4783-a204-1b02f5e88039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:04.180332 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c6b93-3405-4783-a204-1b02f5e88039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:04.181755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c6b93-3405-4783-a204-1b02f5e88039 service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:04.190366 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1391/2766] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:04 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:21.628307 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:21.629698 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:21.684639 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879abed1-3a4c-4cf2-a1f4-d29dfc55ab36 service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:21.688051 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd0259-f255-43c4-96db-f854d20f0917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:21.688692 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd0259-f255-43c4-96db-f854d20f0917 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:21.688974 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd0259-f255-43c4-96db-f854d20f0917 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:21.689251 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd0259-f255-43c4-96db-f854d20f0917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:21.690956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-5acd0259-f255-43c4-96db-f854d20f0917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:21.750575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd0259-f255-43c4-96db-f854d20f0917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:21.752038 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd0259-f255-43c4-96db-f854d20f0917 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:21.761533 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1376/2767] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:21 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:28.800043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c6b93-3405-4783-a204-1b02f5e88039 service cinder] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:28.856775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c6b93-3405-4783-a204-1b02f5e88039 service cinder] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:28.861233 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:28.862122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:28.862354 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:28.862622 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] PATH_INFO: `/v3/users/d1fbae7363f94b4a979c72bae3d13a47` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:28.863759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1fbae7363f94b4a979c72bae3d13a47)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:28.866322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:28.908011 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1fbae7363f94b4a979c72bae3d13a47'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:28.919681 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1fbae7363f94b4a979c72bae3d13a47'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:28.926376 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1fbae7363f94b4a979c72bae3d13a47'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:28.927012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1fbae7363f94b4a979c72bae3d13a47'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:28.934691 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1fbae7363f94b4a979c72bae3d13a47'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:28.940593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1392/2768] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:14:28 2021] DELETE /identity/v3/users/d1fbae7363f94b4a979c72bae3d13a47 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:28.945280 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940148-0778-4e00-84cb-b66883bd3763 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:28.945761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940148-0778-4e00-84cb-b66883bd3763 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:28.945859 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940148-0778-4e00-84cb-b66883bd3763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:28.962289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-73940148-0778-4e00-84cb-b66883bd3763 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:28.963455 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-73940148-0778-4e00-84cb-b66883bd3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:29.019561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1377/2769] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:29.029544 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:29.030881 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:29.086038 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64916965-daa3-45f2-9ebf-b662dda7616f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:29.089566 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd306abf-8e2f-498e-a01a-2e2af31beaa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:29.090204 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd306abf-8e2f-498e-a01a-2e2af31beaa4 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:29.090485 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd306abf-8e2f-498e-a01a-2e2af31beaa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:29.090760 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd306abf-8e2f-498e-a01a-2e2af31beaa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:29.099158 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd306abf-8e2f-498e-a01a-2e2af31beaa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:29.101187 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd306abf-8e2f-498e-a01a-2e2af31beaa4 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:29.110033 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1393/2770] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:29.380017 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73940148-0778-4e00-84cb-b66883bd3763 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:29.381800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-73940148-0778-4e00-84cb-b66883bd3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:29.392926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73940148-0778-4e00-84cb-b66883bd3763 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:29.398027 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:29.398889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:29.399172 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:29.399442 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] PATH_INFO: `/v3/projects/4c198ff0c34440cbae4402761380b342` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:29.400625 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c198ff0c34440cbae4402761380b342)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:29.402548 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:29.447200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c198ff0c34440cbae4402761380b342', 'request_id': 'req-c9b9dd23-e5c5-4636-bd24-25f543833175'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.453360 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c198ff0c34440cbae4402761380b342', 'request_id': 'req-c9b9dd23-e5c5-4636-bd24-25f543833175'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.460697 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c198ff0c34440cbae4402761380b342', 'request_id': 'req-c9b9dd23-e5c5-4636-bd24-25f543833175'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.470875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] The token cache is being invalidate because project 4c198ff0c34440cbae4402761380b342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:29.471160 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.471817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.473357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1378/2771] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:14:29 2021] DELETE /identity/v3/projects/4c198ff0c34440cbae4402761380b342 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:29.478168 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd306abf-8e2f-498e-a01a-2e2af31beaa4 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:29.487203 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd306abf-8e2f-498e-a01a-2e2af31beaa4 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:29.542629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:29.543492 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:29.543801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:29.544077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] PATH_INFO: `/v3/users/3ea77177ce7c4fba9fcabb0c2db8ed13` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:29.545202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea77177ce7c4fba9fcabb0c2db8ed13)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:29.547108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:29.590094 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea77177ce7c4fba9fcabb0c2db8ed13'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.601185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea77177ce7c4fba9fcabb0c2db8ed13'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.607649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea77177ce7c4fba9fcabb0c2db8ed13'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.608581 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea77177ce7c4fba9fcabb0c2db8ed13'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.615502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-b46d8ca7-dc67-4af7-a285-8cb9b583d013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea77177ce7c4fba9fcabb0c2db8ed13'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.621247 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1394/2772] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:14:29 2021] DELETE /identity/v3/users/3ea77177ce7c4fba9fcabb0c2db8ed13 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:14:29.887201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:29.888851 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:29.901915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9dd23-e5c5-4636-bd24-25f543833175 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:29.955834 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:29.956724 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:29.957006 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:29.957279 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] PATH_INFO: `/v3/projects/e4a27b70ab02469a9de5ac3928b9556b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:29.958452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a27b70ab02469a9de5ac3928b9556b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:29.960522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.005752 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a27b70ab02469a9de5ac3928b9556b', 'request_id': 'req-7941b0e9-98f4-4060-bd73-7098c629161f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.012437 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a27b70ab02469a9de5ac3928b9556b', 'request_id': 'req-7941b0e9-98f4-4060-bd73-7098c629161f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.019202 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a27b70ab02469a9de5ac3928b9556b', 'request_id': 'req-7941b0e9-98f4-4060-bd73-7098c629161f'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.029404 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] The token cache is being invalidate because project e4a27b70ab02469a9de5ac3928b9556b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:30.029695 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.030345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7941b0e9-98f4-4060-bd73-7098c629161f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.031890 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1379/2773] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:14:29 2021] DELETE /identity/v3/projects/e4a27b70ab02469a9de5ac3928b9556b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:14:30.037548 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d086d88-f8fc-45a5-ab75-33737b8fcf9b None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.038026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d086d88-f8fc-45a5-ab75-33737b8fcf9b None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.038192 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d086d88-f8fc-45a5-ab75-33737b8fcf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.055302 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-8d086d88-f8fc-45a5-ab75-33737b8fcf9b None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:30.056515 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8d086d88-f8fc-45a5-ab75-33737b8fcf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:30.112205 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1395/2774] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:30.121416 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a6ac3-6169-4f50-873a-480e71ed8907 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.121703 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a6ac3-6169-4f50-873a-480e71ed8907 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.121978 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a6ac3-6169-4f50-873a-480e71ed8907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.140655 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-be5a6ac3-6169-4f50-873a-480e71ed8907 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:30.141803 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-be5a6ac3-6169-4f50-873a-480e71ed8907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:30.149372 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1380/2775] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:30.153463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d086d88-f8fc-45a5-ab75-33737b8fcf9b None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.162398 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d086d88-f8fc-45a5-ab75-33737b8fcf9b None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.167033 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.167788 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.168023 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.168300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] PATH_INFO: `/v3/domains` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.169077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:14:30.169378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.171034 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.183330 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1396/2776] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:14:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:14:30.187550 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a6ac3-6169-4f50-873a-480e71ed8907 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.196992 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a6ac3-6169-4f50-873a-480e71ed8907 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.201428 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b15db-97e4-47e7-a756-b18ccc7ccf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.202064 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b15db-97e4-47e7-a756-b18ccc7ccf61 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.202343 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b15db-97e4-47e7-a756-b18ccc7ccf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.202614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b15db-97e4-47e7-a756-b18ccc7ccf61 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.203283 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b15db-97e4-47e7-a756-b18ccc7ccf61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.205200 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b15db-97e4-47e7-a756-b18ccc7ccf61 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.232198 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1381/2777] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:14:30 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:14:30.236404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.246280 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4f3e-2eb7-4434-85df-ea5e8257dc12 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.302049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09d30-76e5-476e-ad53-4e70ef1212d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.302729 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09d30-76e5-476e-ad53-4e70ef1212d2 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.303767 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09d30-76e5-476e-ad53-4e70ef1212d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.304077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09d30-76e5-476e-ad53-4e70ef1212d2 admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.304769 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09d30-76e5-476e-ad53-4e70ef1212d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.306676 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09d30-76e5-476e-ad53-4e70ef1212d2 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.325968 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1397/2778] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:14:30 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:14:30.330055 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b15db-97e4-47e7-a756-b18ccc7ccf61 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.339559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b15db-97e4-47e7-a756-b18ccc7ccf61 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.344129 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7485b-410f-4bea-94f1-d422052ab35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.344832 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7485b-410f-4bea-94f1-d422052ab35d admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.345119 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7485b-410f-4bea-94f1-d422052ab35d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.345399 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7485b-410f-4bea-94f1-d422052ab35d admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.346118 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7485b-410f-4bea-94f1-d422052ab35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.347770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7485b-410f-4bea-94f1-d422052ab35d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.359045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1382/2779] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:30.362816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09d30-76e5-476e-ad53-4e70ef1212d2 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.372606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09d30-76e5-476e-ad53-4e70ef1212d2 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.377260 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced434ef-a9e5-4707-9574-35875fd27183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.377911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced434ef-a9e5-4707-9574-35875fd27183 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.378194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced434ef-a9e5-4707-9574-35875fd27183 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.378471 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced434ef-a9e5-4707-9574-35875fd27183 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.379180 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced434ef-a9e5-4707-9574-35875fd27183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.380805 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced434ef-a9e5-4707-9574-35875fd27183 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.390327 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1398/2780] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:30.394226 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7485b-410f-4bea-94f1-d422052ab35d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.403459 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7485b-410f-4bea-94f1-d422052ab35d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.407837 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef1b63-f3bb-47d2-bfed-23768e1e2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.408694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef1b63-f3bb-47d2-bfed-23768e1e2e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.408986 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef1b63-f3bb-47d2-bfed-23768e1e2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.409245 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef1b63-f3bb-47d2-bfed-23768e1e2e29 admin admin] PATH_INFO: `/v3/projects/955f4cda77514eb48b3578c41a658c5b/users/90b37b5e31b44d8c94ede85ab26e9f49/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.423348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef1b63-f3bb-47d2-bfed-23768e1e2e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955f4cda77514eb48b3578c41a658c5b, user_id=90b37b5e31b44d8c94ede85ab26e9f49, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.426082 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef1b63-f3bb-47d2-bfed-23768e1e2e29 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.439257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1383/2781] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:14:30 2021] PUT /identity/v3/projects/955f4cda77514eb48b3578c41a658c5b/users/90b37b5e31b44d8c94ede85ab26e9f49/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:14:30.449700 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb513e60-d1a1-40e1-9030-84473ca1ffac None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.449991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb513e60-d1a1-40e1-9030-84473ca1ffac None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.450300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb513e60-d1a1-40e1-9030-84473ca1ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.476649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-bb513e60-d1a1-40e1-9030-84473ca1ffac None None] MFA Rules not processed for user `90b37b5e31b44d8c94ede85ab26e9f49`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:30.477846 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-bb513e60-d1a1-40e1-9030-84473ca1ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:30.539415 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1399/2782] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:30 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:14:30.543755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef1b63-f3bb-47d2-bfed-23768e1e2e29 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.602269 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef1b63-f3bb-47d2-bfed-23768e1e2e29 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.606802 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66d2f3-ba24-49ed-82e9-b3d062fb35b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.607452 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d2f3-ba24-49ed-82e9-b3d062fb35b3 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.608009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d2f3-ba24-49ed-82e9-b3d062fb35b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.608305 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d2f3-ba24-49ed-82e9-b3d062fb35b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.608990 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66d2f3-ba24-49ed-82e9-b3d062fb35b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.610888 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66d2f3-ba24-49ed-82e9-b3d062fb35b3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.635585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1384/2783] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:14:30 2021] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:14:30.639513 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb513e60-d1a1-40e1-9030-84473ca1ffac None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.649832 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb513e60-d1a1-40e1-9030-84473ca1ffac None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.702564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a72b-e879-4d82-89bd-d33d4e9ff07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.703224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a72b-e879-4d82-89bd-d33d4e9ff07a admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.703508 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a72b-e879-4d82-89bd-d33d4e9ff07a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.703813 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a72b-e879-4d82-89bd-d33d4e9ff07a admin admin] PATH_INFO: `/v3/users` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.704500 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9a72b-e879-4d82-89bd-d33d4e9ff07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.706413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9a72b-e879-4d82-89bd-d33d4e9ff07a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.726149 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1400/2784] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:14:30 2021] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:14:30.730089 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66d2f3-ba24-49ed-82e9-b3d062fb35b3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.739699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66d2f3-ba24-49ed-82e9-b3d062fb35b3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.744612 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908324ca-d323-4426-98e2-5200545aa81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.745256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908324ca-d323-4426-98e2-5200545aa81c admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.745536 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908324ca-d323-4426-98e2-5200545aa81c admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.745811 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908324ca-d323-4426-98e2-5200545aa81c admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.746519 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908324ca-d323-4426-98e2-5200545aa81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.748136 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908324ca-d323-4426-98e2-5200545aa81c admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.758778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1385/2785] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:14:30.762663 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a72b-e879-4d82-89bd-d33d4e9ff07a admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.772474 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a72b-e879-4d82-89bd-d33d4e9ff07a admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.777068 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef383fa6-f909-4b0f-b97b-02a6c2f969d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.777938 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383fa6-f909-4b0f-b97b-02a6c2f969d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.778216 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383fa6-f909-4b0f-b97b-02a6c2f969d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.778488 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383fa6-f909-4b0f-b97b-02a6c2f969d5 admin admin] PATH_INFO: `/v3/projects/8c3faecda9e14a60b3eafbc2fc3c86ca/users/8e95373a09f9465aa9b1534301836b8e/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.794697 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383fa6-f909-4b0f-b97b-02a6c2f969d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3faecda9e14a60b3eafbc2fc3c86ca, user_id=8e95373a09f9465aa9b1534301836b8e, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.797341 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383fa6-f909-4b0f-b97b-02a6c2f969d5 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.809628 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1401/2786] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:14:30 2021] PUT /identity/v3/projects/8c3faecda9e14a60b3eafbc2fc3c86ca/users/8e95373a09f9465aa9b1534301836b8e/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:14:30.813490 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908324ca-d323-4426-98e2-5200545aa81c admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.822869 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908324ca-d323-4426-98e2-5200545aa81c admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.876582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97b106-f7c9-414e-80b3-567ec3571cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.877236 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b106-f7c9-414e-80b3-567ec3571cdc admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.877521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b106-f7c9-414e-80b3-567ec3571cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.877799 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b106-f7c9-414e-80b3-567ec3571cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.878508 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97b106-f7c9-414e-80b3-567ec3571cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.880252 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97b106-f7c9-414e-80b3-567ec3571cdc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.890310 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1386/2787] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:14:30.894297 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef383fa6-f909-4b0f-b97b-02a6c2f969d5 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.903932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef383fa6-f909-4b0f-b97b-02a6c2f969d5 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.908194 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.909058 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.909334 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.909601 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] PATH_INFO: `/v3/projects/8c3faecda9e14a60b3eafbc2fc3c86ca/users/8e95373a09f9465aa9b1534301836b8e/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.911412 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3faecda9e14a60b3eafbc2fc3c86ca, user_id=8e95373a09f9465aa9b1534301836b8e, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.914093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.924137 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1402/2788] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:14:30 2021] PUT /identity/v3/projects/8c3faecda9e14a60b3eafbc2fc3c86ca/users/8e95373a09f9465aa9b1534301836b8e/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:14:30.934489 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473bd5-fa80-4221-ad9d-52808242ef06 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.934778 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473bd5-fa80-4221-ad9d-52808242ef06 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.935055 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473bd5-fa80-4221-ad9d-52808242ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.960841 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-24473bd5-fa80-4221-ad9d-52808242ef06 None None] MFA Rules not processed for user `8e95373a09f9465aa9b1534301836b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:30.961995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-24473bd5-fa80-4221-ad9d-52808242ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:31.026926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1387/2789] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:30 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:31.037210 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.039114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:31.092656 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e35752-2cbd-4c25-9f89-56995c95dba1 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.096107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652e08d-8540-4844-9e91-7bfd87dc657d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.096735 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e08d-8540-4844-9e91-7bfd87dc657d service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.097012 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e08d-8540-4844-9e91-7bfd87dc657d service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.097282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e08d-8540-4844-9e91-7bfd87dc657d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.105793 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652e08d-8540-4844-9e91-7bfd87dc657d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.107199 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652e08d-8540-4844-9e91-7bfd87dc657d service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.116405 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1403/2790] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:31 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:31.143906 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24473bd5-fa80-4221-ad9d-52808242ef06 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.202694 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24473bd5-fa80-4221-ad9d-52808242ef06 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.206987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.207874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.208153 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.208425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] PATH_INFO: `/v3/users/90b37b5e31b44d8c94ede85ab26e9f49` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.210282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b37b5e31b44d8c94ede85ab26e9f49)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.212242 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.255573 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b37b5e31b44d8c94ede85ab26e9f49'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.267340 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b37b5e31b44d8c94ede85ab26e9f49'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.268039 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b37b5e31b44d8c94ede85ab26e9f49'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.275658 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b37b5e31b44d8c94ede85ab26e9f49'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.276301 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b37b5e31b44d8c94ede85ab26e9f49'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.289580 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1388/2791] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:14:31 2021] DELETE /identity/v3/users/90b37b5e31b44d8c94ede85ab26e9f49 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:31.294304 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ae4c-cc20-4d9b-9ce5-f83713d23274 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.294587 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ae4c-cc20-4d9b-9ce5-f83713d23274 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.294885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ae4c-cc20-4d9b-9ce5-f83713d23274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.311948 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-d988ae4c-cc20-4d9b-9ce5-f83713d23274 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:31.313198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d988ae4c-cc20-4d9b-9ce5-f83713d23274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:31.368782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1404/2792] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:14:31.378556 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.379941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:31.433916 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751f06f-8f83-446f-bcb1-b8e144711207 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.437429 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313a81-a482-4084-8d80-c622e59bca6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.438066 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313a81-a482-4084-8d80-c622e59bca6c service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.438348 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313a81-a482-4084-8d80-c622e59bca6c service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.438624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313a81-a482-4084-8d80-c622e59bca6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.447595 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b313a81-a482-4084-8d80-c622e59bca6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.449046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b313a81-a482-4084-8d80-c622e59bca6c service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.457736 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1389/2793] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:31.740833 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988ae4c-cc20-4d9b-9ce5-f83713d23274 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.742326 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-d988ae4c-cc20-4d9b-9ce5-f83713d23274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:31.753340 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988ae4c-cc20-4d9b-9ce5-f83713d23274 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.758053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.758915 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.759193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.759468 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] PATH_INFO: `/v3/projects/955f4cda77514eb48b3578c41a658c5b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.760649 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=955f4cda77514eb48b3578c41a658c5b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.762572 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.807723 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955f4cda77514eb48b3578c41a658c5b', 'request_id': 'req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.813616 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955f4cda77514eb48b3578c41a658c5b', 'request_id': 'req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.820671 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955f4cda77514eb48b3578c41a658c5b', 'request_id': 'req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.830289 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] The token cache is being invalidate because project 955f4cda77514eb48b3578c41a658c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:31.830567 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.831176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.832764 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1405/2794] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:14:31 2021] DELETE /identity/v3/projects/955f4cda77514eb48b3578c41a658c5b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:31.836754 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313a81-a482-4084-8d80-c622e59bca6c service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.845601 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313a81-a482-4084-8d80-c622e59bca6c service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.900381 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.901240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.901524 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.901795 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] PATH_INFO: `/v3/users/8e95373a09f9465aa9b1534301836b8e` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.902930 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e95373a09f9465aa9b1534301836b8e)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.904920 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.949149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e95373a09f9465aa9b1534301836b8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.960367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e95373a09f9465aa9b1534301836b8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.961042 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e95373a09f9465aa9b1534301836b8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.968149 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e95373a09f9465aa9b1534301836b8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.968769 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-068db63d-7f99-48d9-b273-4c3f936a17d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e95373a09f9465aa9b1534301836b8e'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:31.981151 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1390/2795] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:14:31 2021] DELETE /identity/v3/users/8e95373a09f9465aa9b1534301836b8e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:32.247871 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:32.249379 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:32.265028 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f5c58-a0f0-46e3-97c4-6f2ad339b50c admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:32.321514 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:32.322378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.322661 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.323067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] PATH_INFO: `/v3/projects/8c3faecda9e14a60b3eafbc2fc3c86ca` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.324232 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3faecda9e14a60b3eafbc2fc3c86ca)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:32.326132 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:32.370603 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3faecda9e14a60b3eafbc2fc3c86ca', 'request_id': 'req-693c95b1-f860-4d71-87c7-893f352b7d1c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:32.376816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3faecda9e14a60b3eafbc2fc3c86ca', 'request_id': 'req-693c95b1-f860-4d71-87c7-893f352b7d1c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:32.384224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3faecda9e14a60b3eafbc2fc3c86ca', 'request_id': 'req-693c95b1-f860-4d71-87c7-893f352b7d1c'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:32.393808 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] The token cache is being invalidate because project 8c3faecda9e14a60b3eafbc2fc3c86ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:32.394092 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:32.394702 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-693c95b1-f860-4d71-87c7-893f352b7d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:32.396242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1406/2796] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:14:32 2021] DELETE /identity/v3/projects/8c3faecda9e14a60b3eafbc2fc3c86ca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:32.402470 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9164d-0e97-46c4-bef4-5bb9136ba9d2 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.402761 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9164d-0e97-46c4-bef4-5bb9136ba9d2 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.403045 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9164d-0e97-46c4-bef4-5bb9136ba9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.420425 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-71c9164d-0e97-46c4-bef4-5bb9136ba9d2 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:32.421588 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-71c9164d-0e97-46c4-bef4-5bb9136ba9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:32.477339 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1391/2797] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:32.527725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a96522-a819-4707-bbe6-5ee70d49c656 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.527906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a96522-a819-4707-bbe6-5ee70d49c656 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.528189 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a96522-a819-4707-bbe6-5ee70d49c656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.546305 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-92a96522-a819-4707-bbe6-5ee70d49c656 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:32.547499 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-92a96522-a819-4707-bbe6-5ee70d49c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:32.556112 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1407/2798] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:32.560410 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9164d-0e97-46c4-bef4-5bb9136ba9d2 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:32.569885 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9164d-0e97-46c4-bef4-5bb9136ba9d2 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:32.574525 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:32.575194 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.575494 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.575805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.576521 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:14:32.576823 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:32.578433 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:32.590717 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1392/2799] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:14:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:14:32.595104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a96522-a819-4707-bbe6-5ee70d49c656 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:32.603754 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a96522-a819-4707-bbe6-5ee70d49c656 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:32.608561 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5aa1-94a3-4469-af07-2b7075584d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:32.609208 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5aa1-94a3-4469-af07-2b7075584d71 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.609495 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5aa1-94a3-4469-af07-2b7075584d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.609773 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5aa1-94a3-4469-af07-2b7075584d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.610463 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a5aa1-94a3-4469-af07-2b7075584d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:32.612407 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a5aa1-94a3-4469-af07-2b7075584d71 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:32.636783 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1408/2800] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:14:32 2021] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:14:32.640830 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:32.650787 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d871b-4de0-43e4-8dff-c44ecd2b1015 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:32.704621 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b95ff-6ac4-404b-8fc2-427384a91916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:32.705287 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b95ff-6ac4-404b-8fc2-427384a91916 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.705570 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b95ff-6ac4-404b-8fc2-427384a91916 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.705849 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b95ff-6ac4-404b-8fc2-427384a91916 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.706535 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b95ff-6ac4-404b-8fc2-427384a91916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:32.708506 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b95ff-6ac4-404b-8fc2-427384a91916 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:32.729257 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1393/2801] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:14:32 2021] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:14:32.733674 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5aa1-94a3-4469-af07-2b7075584d71 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:32.743160 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5aa1-94a3-4469-af07-2b7075584d71 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:32.747450 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544da2e6-3860-4732-9a01-e58d8c0636f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:32.748135 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544da2e6-3860-4732-9a01-e58d8c0636f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.748419 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544da2e6-3860-4732-9a01-e58d8c0636f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.748696 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544da2e6-3860-4732-9a01-e58d8c0636f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.749414 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544da2e6-3860-4732-9a01-e58d8c0636f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:32.750990 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544da2e6-3860-4732-9a01-e58d8c0636f0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:32.761918 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1409/2802] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:32.765889 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b95ff-6ac4-404b-8fc2-427384a91916 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:32.775956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b95ff-6ac4-404b-8fc2-427384a91916 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:32.780379 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec781096-f60b-4e2b-ba94-dac43643ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:32.780975 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec781096-f60b-4e2b-ba94-dac43643ba13 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.781255 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec781096-f60b-4e2b-ba94-dac43643ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.781528 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec781096-f60b-4e2b-ba94-dac43643ba13 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.782241 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec781096-f60b-4e2b-ba94-dac43643ba13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:32.783862 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec781096-f60b-4e2b-ba94-dac43643ba13 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:32.793685 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1394/2803] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:14:32.797683 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544da2e6-3860-4732-9a01-e58d8c0636f0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:32.806865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544da2e6-3860-4732-9a01-e58d8c0636f0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:32.811156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72dd36-60ef-494f-b572-672feacd13b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:32.812077 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72dd36-60ef-494f-b572-672feacd13b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.812360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72dd36-60ef-494f-b572-672feacd13b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.812629 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72dd36-60ef-494f-b572-672feacd13b0 admin admin] PATH_INFO: `/v3/projects/2441722bc35340e596e7608d164d3629/users/d39cd9cbce2d439982c6a65e590513f4/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.826635 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72dd36-60ef-494f-b572-672feacd13b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2441722bc35340e596e7608d164d3629, user_id=d39cd9cbce2d439982c6a65e590513f4, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:32.829299 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72dd36-60ef-494f-b572-672feacd13b0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:32.842770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1410/2804] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:14:32 2021] PUT /identity/v3/projects/2441722bc35340e596e7608d164d3629/users/d39cd9cbce2d439982c6a65e590513f4/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:14:32.852846 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2db30-30d9-410e-bdfe-71335b4a7a69 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:32.853131 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2db30-30d9-410e-bdfe-71335b4a7a69 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:32.853430 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2db30-30d9-410e-bdfe-71335b4a7a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:32.879826 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-89c2db30-30d9-410e-bdfe-71335b4a7a69 None None] MFA Rules not processed for user `d39cd9cbce2d439982c6a65e590513f4`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:32.881440 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-89c2db30-30d9-410e-bdfe-71335b4a7a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:32.942231 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1395/2805] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:32 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:14:32.946830 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72dd36-60ef-494f-b572-672feacd13b0 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:33.008310 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72dd36-60ef-494f-b572-672feacd13b0 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:33.012647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956f76f-d089-4027-9205-b77159b9526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:33.013291 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956f76f-d089-4027-9205-b77159b9526e admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.013576 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956f76f-d089-4027-9205-b77159b9526e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.013837 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956f76f-d089-4027-9205-b77159b9526e admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.014507 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956f76f-d089-4027-9205-b77159b9526e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:33.016438 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956f76f-d089-4027-9205-b77159b9526e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:33.041504 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1411/2806] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:14:32 2021] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:14:33.045448 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2db30-30d9-410e-bdfe-71335b4a7a69 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:33.055810 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2db30-30d9-410e-bdfe-71335b4a7a69 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:33.109567 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ed0a-6fd7-4cc9-a86f-ec2b81de8de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:33.110222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ed0a-6fd7-4cc9-a86f-ec2b81de8de0 admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.110500 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ed0a-6fd7-4cc9-a86f-ec2b81de8de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.110768 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ed0a-6fd7-4cc9-a86f-ec2b81de8de0 admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.111451 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967ed0a-6fd7-4cc9-a86f-ec2b81de8de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:33.113462 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967ed0a-6fd7-4cc9-a86f-ec2b81de8de0 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:33.131872 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1396/2807] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:14:33 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:14:33.135860 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956f76f-d089-4027-9205-b77159b9526e admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:33.145114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956f76f-d089-4027-9205-b77159b9526e admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:33.149994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501e665-afbb-485b-b742-2d2d51579985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:33.150639 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501e665-afbb-485b-b742-2d2d51579985 admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.150917 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501e665-afbb-485b-b742-2d2d51579985 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.151188 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501e665-afbb-485b-b742-2d2d51579985 admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.151923 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501e665-afbb-485b-b742-2d2d51579985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:33.153494 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501e665-afbb-485b-b742-2d2d51579985 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:33.164134 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1412/2808] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:33 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:33.168105 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ed0a-6fd7-4cc9-a86f-ec2b81de8de0 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:33.177191 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ed0a-6fd7-4cc9-a86f-ec2b81de8de0 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:33.181878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba2f3-35ca-4d09-b010-f601177c0994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:33.182747 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba2f3-35ca-4d09-b010-f601177c0994 admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.183021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba2f3-35ca-4d09-b010-f601177c0994 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.183289 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba2f3-35ca-4d09-b010-f601177c0994 admin admin] PATH_INFO: `/v3/projects/2f1d68c9bab84fa7aae5a5fc8614ebb0/users/4d7bcb571779474ebf69baf06844f3a2/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.197367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba2f3-35ca-4d09-b010-f601177c0994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1d68c9bab84fa7aae5a5fc8614ebb0, user_id=4d7bcb571779474ebf69baf06844f3a2, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:33.200033 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba2f3-35ca-4d09-b010-f601177c0994 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:33.213338 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1397/2809] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:14:33 2021] PUT /identity/v3/projects/2f1d68c9bab84fa7aae5a5fc8614ebb0/users/4d7bcb571779474ebf69baf06844f3a2/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:14:33.217218 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501e665-afbb-485b-b742-2d2d51579985 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:33.226768 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501e665-afbb-485b-b742-2d2d51579985 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:33.280423 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2635893-de91-4706-b523-aa4ab20e428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:33.281085 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2635893-de91-4706-b523-aa4ab20e428e admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.281364 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2635893-de91-4706-b523-aa4ab20e428e admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.281636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2635893-de91-4706-b523-aa4ab20e428e admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.282358 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2635893-de91-4706-b523-aa4ab20e428e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:33.283944 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2635893-de91-4706-b523-aa4ab20e428e admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:33.293957 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1413/2810] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:33 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:14:33.298008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba2f3-35ca-4d09-b010-f601177c0994 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:33.307852 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba2f3-35ca-4d09-b010-f601177c0994 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:33.312145 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:33.313009 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.313281 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.313555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] PATH_INFO: `/v3/projects/2f1d68c9bab84fa7aae5a5fc8614ebb0/users/4d7bcb571779474ebf69baf06844f3a2/roles/4603f7973a2c4eb59397a4b7f0c6638c` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.315384 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1d68c9bab84fa7aae5a5fc8614ebb0, user_id=4d7bcb571779474ebf69baf06844f3a2, role_id=4603f7973a2c4eb59397a4b7f0c6638c)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:33.318030 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:33.328734 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1398/2811] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:14:33 2021] PUT /identity/v3/projects/2f1d68c9bab84fa7aae5a5fc8614ebb0/users/4d7bcb571779474ebf69baf06844f3a2/roles/4603f7973a2c4eb59397a4b7f0c6638c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:33.339478 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127f605-9b3a-4b28-b71f-5c240d754383 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.339802 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127f605-9b3a-4b28-b71f-5c240d754383 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.340107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127f605-9b3a-4b28-b71f-5c240d754383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.364994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-9127f605-9b3a-4b28-b71f-5c240d754383 None None] MFA Rules not processed for user `4d7bcb571779474ebf69baf06844f3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:33.366181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-9127f605-9b3a-4b28-b71f-5c240d754383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:33.430746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1414/2812] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:33 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:33.441147 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:33.442780 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:33.501292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d8f4-b37a-4c98-a73f-fb5e6f445a1d admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:33.504739 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a098-9d6e-4970-ae3d-6379c111851b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:33.505366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a098-9d6e-4970-ae3d-6379c111851b service cinder] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.505643 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a098-9d6e-4970-ae3d-6379c111851b service cinder] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.506773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a098-9d6e-4970-ae3d-6379c111851b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.515294 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975a098-9d6e-4970-ae3d-6379c111851b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:33.516757 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975a098-9d6e-4970-ae3d-6379c111851b service cinder] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:33.526445 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1399/2813] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:33 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:33.605575 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127f605-9b3a-4b28-b71f-5c240d754383 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:33.617409 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127f605-9b3a-4b28-b71f-5c240d754383 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:33.621095 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43bbef-4309-4602-b1e6-c54afb1be52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:33.621737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43bbef-4309-4602-b1e6-c54afb1be52b service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:33.622014 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43bbef-4309-4602-b1e6-c54afb1be52b service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:33.622287 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43bbef-4309-4602-b1e6-c54afb1be52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:33.675156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43bbef-4309-4602-b1e6-c54afb1be52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:33.676626 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43bbef-4309-4602-b1e6-c54afb1be52b service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:33.685349 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1415/2814] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:33 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:38.244965 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a098-9d6e-4970-ae3d-6379c111851b service cinder] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:38.305184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a098-9d6e-4970-ae3d-6379c111851b service cinder] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:38.309609 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:38.310469 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:38.310750 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:38.311024 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] PATH_INFO: `/v3/users/d39cd9cbce2d439982c6a65e590513f4` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:38.312184 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39cd9cbce2d439982c6a65e590513f4)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:38.314117 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:38.359333 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39cd9cbce2d439982c6a65e590513f4'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.372197 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39cd9cbce2d439982c6a65e590513f4'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.372874 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39cd9cbce2d439982c6a65e590513f4'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.379748 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39cd9cbce2d439982c6a65e590513f4'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.380367 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39cd9cbce2d439982c6a65e590513f4'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.392341 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1400/2815] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:14:38 2021] DELETE /identity/v3/users/d39cd9cbce2d439982c6a65e590513f4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:38.397547 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d037b-2f0f-43d1-a982-95537a1c6dfb None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:38.398005 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d037b-2f0f-43d1-a982-95537a1c6dfb None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:38.398093 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d037b-2f0f-43d1-a982-95537a1c6dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:38.414992 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-893d037b-2f0f-43d1-a982-95537a1c6dfb None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:38.416191 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-893d037b-2f0f-43d1-a982-95537a1c6dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:38.472911 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1416/2816] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:14:38.483222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:38.484575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:38.538941 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a0ab9-ba67-47df-bd90-02356c603e58 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:38.542380 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5c640-b8ce-4ba2-bfe3-2b00a0938f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:38.543011 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5c640-b8ce-4ba2-bfe3-2b00a0938f66 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:38.543291 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5c640-b8ce-4ba2-bfe3-2b00a0938f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:38.543568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5c640-b8ce-4ba2-bfe3-2b00a0938f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:38.552046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5c640-b8ce-4ba2-bfe3-2b00a0938f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:38.554110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5c640-b8ce-4ba2-bfe3-2b00a0938f66 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:38.562794 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1401/2817] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:14:38.831234 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d037b-2f0f-43d1-a982-95537a1c6dfb None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:38.832770 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-893d037b-2f0f-43d1-a982-95537a1c6dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:38.845856 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d037b-2f0f-43d1-a982-95537a1c6dfb None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:38.851087 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:38.851980 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:38.852262 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:38.852531 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] PATH_INFO: `/v3/projects/2441722bc35340e596e7608d164d3629` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:38.853755 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2441722bc35340e596e7608d164d3629)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:38.855647 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:38.901816 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2441722bc35340e596e7608d164d3629', 'request_id': 'req-e85f9899-09e5-4d16-a407-3a3cfed7f598'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.907831 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2441722bc35340e596e7608d164d3629', 'request_id': 'req-e85f9899-09e5-4d16-a407-3a3cfed7f598'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.915122 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2441722bc35340e596e7608d164d3629', 'request_id': 'req-e85f9899-09e5-4d16-a407-3a3cfed7f598'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.924645 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] The token cache is being invalidate because project 2441722bc35340e596e7608d164d3629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:38.924925 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.925564 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:38.927043 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1417/2818] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:14:38 2021] DELETE /identity/v3/projects/2441722bc35340e596e7608d164d3629 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:38.931328 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5c640-b8ce-4ba2-bfe3-2b00a0938f66 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:38.940293 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5c640-b8ce-4ba2-bfe3-2b00a0938f66 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:38.994614 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:38.995465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:38.995770 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:38.996046 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] PATH_INFO: `/v3/users/4d7bcb571779474ebf69baf06844f3a2` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:38.997174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7bcb571779474ebf69baf06844f3a2)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:38.999097 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:39.042225 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7bcb571779474ebf69baf06844f3a2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.054125 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7bcb571779474ebf69baf06844f3a2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.054696 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7bcb571779474ebf69baf06844f3a2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.062820 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7bcb571779474ebf69baf06844f3a2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.063569 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-26cde8fc-597f-4126-a310-1b8ba8bc31c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7bcb571779474ebf69baf06844f3a2'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.075564 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1402/2819] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:14:38 2021] DELETE /identity/v3/users/4d7bcb571779474ebf69baf06844f3a2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:39.348662 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:39.350114 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:39.363198 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9899-09e5-4d16-a407-3a3cfed7f598 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:39.419682 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:39.420557 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.420836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.421107 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] PATH_INFO: `/v3/projects/2f1d68c9bab84fa7aae5a5fc8614ebb0` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.422223 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1d68c9bab84fa7aae5a5fc8614ebb0)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:39.424161 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:39.468163 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1d68c9bab84fa7aae5a5fc8614ebb0', 'request_id': 'req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.473875 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1d68c9bab84fa7aae5a5fc8614ebb0', 'request_id': 'req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.481109 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1d68c9bab84fa7aae5a5fc8614ebb0', 'request_id': 'req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.491439 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] The token cache is being invalidate because project 2f1d68c9bab84fa7aae5a5fc8614ebb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:39.491746 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.492372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7fc64af4-6400-40af-9ae1-a0ac72e2d77a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:39.493886 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1418/2820] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:14:39 2021] DELETE /identity/v3/projects/2f1d68c9bab84fa7aae5a5fc8614ebb0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:39.501114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f83b-d898-45a2-bd4f-3752d2e20e42 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.501563 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f83b-d898-45a2-bd4f-3752d2e20e42 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.501651 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f83b-d898-45a2-bd4f-3752d2e20e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.519357 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-75a7f83b-d898-45a2-bd4f-3752d2e20e42 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:39.520555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-75a7f83b-d898-45a2-bd4f-3752d2e20e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:39.575731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1403/2821] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:14:39.583565 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917b9a2-0cc5-4fcc-b067-08a2be579ca6 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.584922 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917b9a2-0cc5-4fcc-b067-08a2be579ca6 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.585224 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917b9a2-0cc5-4fcc-b067-08a2be579ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.602667 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-6917b9a2-0cc5-4fcc-b067-08a2be579ca6 None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:39.603878 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6917b9a2-0cc5-4fcc-b067-08a2be579ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:39.611372 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1419/2822] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:39.616110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7f83b-d898-45a2-bd4f-3752d2e20e42 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:39.625173 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7f83b-d898-45a2-bd4f-3752d2e20e42 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:39.629438 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:39.630074 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.630443 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.630843 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] PATH_INFO: `/v3/domains` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.631652 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:14:39.631987 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:39.633575 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:39.644581 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1404/2823] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Jul 28 04:14:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:14:39.649320 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917b9a2-0cc5-4fcc-b067-08a2be579ca6 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:39.657591 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917b9a2-0cc5-4fcc-b067-08a2be579ca6 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:39.661919 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475fa8-1136-4eaf-ab3a-5ce47a5e2a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:39.663273 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475fa8-1136-4eaf-ab3a-5ce47a5e2a52 admin admin] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.663558 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475fa8-1136-4eaf-ab3a-5ce47a5e2a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.663867 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475fa8-1136-4eaf-ab3a-5ce47a5e2a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.664551 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475fa8-1136-4eaf-ab3a-5ce47a5e2a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:39.666426 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475fa8-1136-4eaf-ab3a-5ce47a5e2a52 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:39.690606 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1420/2824] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Jul 28 04:14:39 2021] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:14:39.694664 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:39.703919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12202f5-be48-4268-8cfe-573f660f00fc admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:39.756793 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaca7a-dacd-4a9a-aef1-7db5650b6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:39.757370 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaca7a-dacd-4a9a-aef1-7db5650b6f3e admin admin] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.757647 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaca7a-dacd-4a9a-aef1-7db5650b6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.757917 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaca7a-dacd-4a9a-aef1-7db5650b6f3e admin admin] PATH_INFO: `/v3/users` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.758624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaca7a-dacd-4a9a-aef1-7db5650b6f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:39.760551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaca7a-dacd-4a9a-aef1-7db5650b6f3e admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:39.782263 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1405/2825] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 28 04:14:39 2021] POST /identity/v3/users => generated 287 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:14:39.783529 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475fa8-1136-4eaf-ab3a-5ce47a5e2a52 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:39.793484 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475fa8-1136-4eaf-ab3a-5ce47a5e2a52 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:39.798105 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c013c8-2ac0-42f9-a3f7-11a54fe8ff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:39.798749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c013c8-2ac0-42f9-a3f7-11a54fe8ff4f admin admin] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.799026 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c013c8-2ac0-42f9-a3f7-11a54fe8ff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.799296 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c013c8-2ac0-42f9-a3f7-11a54fe8ff4f admin admin] PATH_INFO: `/v3/roles` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.800161 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c013c8-2ac0-42f9-a3f7-11a54fe8ff4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:39.801738 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c013c8-2ac0-42f9-a3f7-11a54fe8ff4f admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:39.811923 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1421/2826] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:14:39.815653 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaca7a-dacd-4a9a-aef1-7db5650b6f3e admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:39.824878 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaca7a-dacd-4a9a-aef1-7db5650b6f3e admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:39.829183 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc879ca-9171-4fa7-b02f-150c03ab01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:39.829831 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc879ca-9171-4fa7-b02f-150c03ab01d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.830112 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc879ca-9171-4fa7-b02f-150c03ab01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.830388 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc879ca-9171-4fa7-b02f-150c03ab01d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.831099 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc879ca-9171-4fa7-b02f-150c03ab01d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:39.832706 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc879ca-9171-4fa7-b02f-150c03ab01d4 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:39.842995 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1406/2827] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Jul 28 04:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:39.846772 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c013c8-2ac0-42f9-a3f7-11a54fe8ff4f admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:39.856070 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c013c8-2ac0-42f9-a3f7-11a54fe8ff4f admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:39.860605 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:39.861454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] REQUEST_METHOD: `PUT` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.861732 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.862002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] PATH_INFO: `/v3/projects/e9e78a86e18c4df3b6a1e756fa51fc10/users/ae1a5c628b764cf48b6bb85dd1f1c831/roles/ed504008bcef4191855e83ad32f4c9a4` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.875607 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e78a86e18c4df3b6a1e756fa51fc10, user_id=ae1a5c628b764cf48b6bb85dd1f1c831, role_id=ed504008bcef4191855e83ad32f4c9a4)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:39.878240 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:39.890300 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1422/2828] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Jul 28 04:14:39 2021] PUT /identity/v3/projects/e9e78a86e18c4df3b6a1e756fa51fc10/users/ae1a5c628b764cf48b6bb85dd1f1c831/roles/ed504008bcef4191855e83ad32f4c9a4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:39.900956 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb1d3-09d6-4e01-8bdc-3a981d4ad00f None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:39.901256 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb1d3-09d6-4e01-8bdc-3a981d4ad00f None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:39.901545 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb1d3-09d6-4e01-8bdc-3a981d4ad00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:39.928572 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-458fb1d3-09d6-4e01-8bdc-3a981d4ad00f None None] MFA Rules not processed for user `ae1a5c628b764cf48b6bb85dd1f1c831`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:39.929760 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-458fb1d3-09d6-4e01-8bdc-3a981d4ad00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:39.991203 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1407/2829] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:39 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:14:40.001175 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:40.002775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:40.057152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb517-9322-424b-b9f0-23a33e431061 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:40.060552 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ad2c0-a2bd-4fd7-ad35-d0b1352094dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a02f0a6cbe5442da8bd2f78643d31aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:40.061186 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad2c0-a2bd-4fd7-ad35-d0b1352094dd service cinder] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:40.061466 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad2c0-a2bd-4fd7-ad35-d0b1352094dd service cinder] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:40.061756 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad2c0-a2bd-4fd7-ad35-d0b1352094dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:40.070378 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ad2c0-a2bd-4fd7-ad35-d0b1352094dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:40.071823 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ad2c0-a2bd-4fd7-ad35-d0b1352094dd service cinder] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:40.079796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1423/2830] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:40 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:41.421699 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c5ec5-5de5-4adb-9b23-a0a11c6d3c1a None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:41.422167 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c5ec5-5de5-4adb-9b23-a0a11c6d3c1a None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:41.422270 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c5ec5-5de5-4adb-9b23-a0a11c6d3c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:41.439585 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-173c5ec5-5de5-4adb-9b23-a0a11c6d3c1a None None] MFA Rules not processed for user `ae1a5c628b764cf48b6bb85dd1f1c831`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:41.440773 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-173c5ec5-5de5-4adb-9b23-a0a11c6d3c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:41.447684 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1408/2831] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:41 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:56.099989 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc345a7-023d-4f09-820a-ed2c683e924c None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:56.100455 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc345a7-023d-4f09-820a-ed2c683e924c None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:56.100562 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc345a7-023d-4f09-820a-ed2c683e924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:56.119360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1dc345a7-023d-4f09-820a-ed2c683e924c None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:56.120638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1dc345a7-023d-4f09-820a-ed2c683e924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:56.175897 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1424/2832] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 04:14:56 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:56.217414 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c5ec5-5de5-4adb-9b23-a0a11c6d3c1a None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:56.220753 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-173c5ec5-5de5-4adb-9b23-a0a11c6d3c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:56.289968 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c5ec5-5de5-4adb-9b23-a0a11c6d3c1a None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:56.294774 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e63af-239d-41b9-b603-a38f13dd4616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:56.295424 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e63af-239d-41b9-b603-a38f13dd4616 service swift] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:56.295731 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e63af-239d-41b9-b603-a38f13dd4616 service swift] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:56.296008 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e63af-239d-41b9-b603-a38f13dd4616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:56.304114 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e63af-239d-41b9-b603-a38f13dd4616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:56.305704 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e63af-239d-41b9-b603-a38f13dd4616 service swift] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:56.313587 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1409/2833] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 04:14:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:56.915343 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c45c7-a701-463a-a254-22940f7ad346 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:56.915637 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c45c7-a701-463a-a254-22940f7ad346 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:56.915942 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c45c7-a701-463a-a254-22940f7ad346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:56.932975 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-625c45c7-a701-463a-a254-22940f7ad346 None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:56.934128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-625c45c7-a701-463a-a254-22940f7ad346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:56.940725 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1425/2834] 10.222.0.16 () {58 vars in 1010 bytes} [Wed Jul 28 04:14:56 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:56.953523 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e63af-239d-41b9-b603-a38f13dd4616 service swift] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:56.963853 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e63af-239d-41b9-b603-a38f13dd4616 service swift] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:56.968604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d54f1f-09c2-4050-b0f5-a9778eda9acd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:56.969238 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d54f1f-09c2-4050-b0f5-a9778eda9acd service swift] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:56.969522 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d54f1f-09c2-4050-b0f5-a9778eda9acd service swift] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:56.969805 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d54f1f-09c2-4050-b0f5-a9778eda9acd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:56.977602 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d54f1f-09c2-4050-b0f5-a9778eda9acd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:56.979181 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d54f1f-09c2-4050-b0f5-a9778eda9acd service swift] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:56.986940 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1410/2835] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 04:14:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:57.318542 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243c76e-e367-4b60-941c-b3b6a052ffcd None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.318996 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243c76e-e367-4b60-941c-b3b6a052ffcd None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.319104 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243c76e-e367-4b60-941c-b3b6a052ffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.337599 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-1243c76e-e367-4b60-941c-b3b6a052ffcd None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:57.338713 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-1243c76e-e367-4b60-941c-b3b6a052ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:57.345533 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1426/2836] 10.222.0.16 () {58 vars in 968 bytes} [Wed Jul 28 04:14:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:57.358985 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d54f1f-09c2-4050-b0f5-a9778eda9acd service swift] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:57.370484 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d54f1f-09c2-4050-b0f5-a9778eda9acd service swift] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:57.375313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47082c-0ee2-4c42-bba2-886e81b18e86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:57.375994 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47082c-0ee2-4c42-bba2-886e81b18e86 service swift] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.376302 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47082c-0ee2-4c42-bba2-886e81b18e86 service swift] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.376772 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47082c-0ee2-4c42-bba2-886e81b18e86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.385098 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47082c-0ee2-4c42-bba2-886e81b18e86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:57.386693 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47082c-0ee2-4c42-bba2-886e81b18e86 service swift] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:57.394366 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1411/2837] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 04:14:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:59.537404 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243c76e-e367-4b60-941c-b3b6a052ffcd None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:59.596357 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243c76e-e367-4b60-941c-b3b6a052ffcd None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:59.600730 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:59.602079 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:59.602360 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:59.602634 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] PATH_INFO: `/v3/users/ae1a5c628b764cf48b6bb85dd1f1c831` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:59.603820 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1a5c628b764cf48b6bb85dd1f1c831)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:59.605737 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:59.649759 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1a5c628b764cf48b6bb85dd1f1c831'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:59.661193 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1a5c628b764cf48b6bb85dd1f1c831'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:59.668373 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1a5c628b764cf48b6bb85dd1f1c831'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:59.669067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1a5c628b764cf48b6bb85dd1f1c831'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:59.676506 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1a5c628b764cf48b6bb85dd1f1c831'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:59.682998 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1427/2838] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:14:59 2021] DELETE /identity/v3/users/ae1a5c628b764cf48b6bb85dd1f1c831 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:59.687561 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988ea6-22b5-4b88-9063-fa7f08238c3c None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:59.688057 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988ea6-22b5-4b88-9063-fa7f08238c3c None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:59.688166 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988ea6-22b5-4b88-9063-fa7f08238c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:59.705963 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-29988ea6-22b5-4b88-9063-fa7f08238c3c None None] MFA Rules not processed for user `398ba2372d694a5b8498f1f6df8ec46d`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:59.707134 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-29988ea6-22b5-4b88-9063-fa7f08238c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:59.765018 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1412/2839] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:14:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:14:59.775930 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:59.777252 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:59.832352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c027603-b822-475c-b2c9-b0f48d89f61d admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:59.835863 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e20191-4b76-47ae-9646-1b4889f6a6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:59.836502 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e20191-4b76-47ae-9646-1b4889f6a6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:59.836782 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e20191-4b76-47ae-9646-1b4889f6a6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:59.837053 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e20191-4b76-47ae-9646-1b4889f6a6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:59.845406 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e20191-4b76-47ae-9646-1b4889f6a6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:59.846841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e20191-4b76-47ae-9646-1b4889f6a6b2 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:59.856214 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1428/2840] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:14:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:15:00.018268 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29988ea6-22b5-4b88-9063-fa7f08238c3c None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:00.019650 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-29988ea6-22b5-4b88-9063-fa7f08238c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:00.034239 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29988ea6-22b5-4b88-9063-fa7f08238c3c None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:00.039819 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:00.040667 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:00.040997 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:00.041371 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] PATH_INFO: `/v3/projects/e9e78a86e18c4df3b6a1e756fa51fc10` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:00.042415 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e78a86e18c4df3b6a1e756fa51fc10)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:00.044342 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:00.089240 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'request_id': 'req-4bc419a1-b680-4068-ae2a-43ea38764f16'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:00.095140 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'request_id': 'req-4bc419a1-b680-4068-ae2a-43ea38764f16'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:00.102798 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'request_id': 'req-4bc419a1-b680-4068-ae2a-43ea38764f16'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:00.112915 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] The token cache is being invalidate because project e9e78a86e18c4df3b6a1e756fa51fc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:15:00.113201 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:00.113817 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-4bc419a1-b680-4068-ae2a-43ea38764f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:00.115334 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1413/2841] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:15:00 2021] DELETE /identity/v3/projects/e9e78a86e18c4df3b6a1e756fa51fc10 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:15:25.348277 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511b3bb-58b2-422d-9378-384c95326193 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:25.348715 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511b3bb-58b2-422d-9378-384c95326193 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:25.348836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511b3bb-58b2-422d-9378-384c95326193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:25.366932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-b511b3bb-58b2-422d-9378-384c95326193 None None] MFA Rules not processed for user `21290886e90f45f582840b785d64cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:15:25.368156 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b511b3bb-58b2-422d-9378-384c95326193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:25.418758 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1429/2842] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:15:25 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:15:45.864152 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a7b4-2896-4fad-9efd-59753727d099 None None] REQUEST_METHOD: `POST` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:45.864746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a7b4-2896-4fad-9efd-59753727d099 None None] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:45.864746 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a7b4-2896-4fad-9efd-59753727d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:45.883663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.auth.core [None req-9f08a7b4-2896-4fad-9efd-59753727d099 None None] MFA Rules not processed for user `e17902fcace54636bd031101c4672759`. Rule list: `[]` (Enabled: `True`). {{(pid=72579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:15:45.885050 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9f08a7b4-2896-4fad-9efd-59753727d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:45.944720 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1414/2843] 10.222.0.16 () {58 vars in 968 bytes} [Wed Jul 28 04:15:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:15:45.956977 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511b3bb-58b2-422d-9378-384c95326193 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:45.958338 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-b511b3bb-58b2-422d-9378-384c95326193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:46.033841 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511b3bb-58b2-422d-9378-384c95326193 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:46.038912 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f56fea-4b31-4a52-900d-360b6ee7470c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7195fd0ceaf6413d80120c47b3c86358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:46.039580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56fea-4b31-4a52-900d-360b6ee7470c service swift] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:46.039906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56fea-4b31-4a52-900d-360b6ee7470c service swift] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:46.040181 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56fea-4b31-4a52-900d-360b6ee7470c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:46.048712 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f56fea-4b31-4a52-900d-360b6ee7470c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:46.050323 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f56fea-4b31-4a52-900d-360b6ee7470c service swift] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:46.058749 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1430/2844] 10.222.0.16 () {60 vars in 1385 bytes} [Wed Jul 28 04:15:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:15:52.807515 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08a7b4-2896-4fad-9efd-59753727d099 None None] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:52.810644 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-9f08a7b4-2896-4fad-9efd-59753727d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:52.876292 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08a7b4-2896-4fad-9efd-59753727d099 None None] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:52.880559 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:52.881465 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:52.881743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:52.882180 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] PATH_INFO: `/v3/users/8a85216c17234c099440b2e2c7934755` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:52.883362 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a85216c17234c099440b2e2c7934755)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:52.885345 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:52.932211 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a85216c17234c099440b2e2c7934755'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:52.945377 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a85216c17234c099440b2e2c7934755'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:52.946083 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a85216c17234c099440b2e2c7934755'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:52.953355 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a85216c17234c099440b2e2c7934755'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:52.953979 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a85216c17234c099440b2e2c7934755'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:52.966481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1415/2845] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:15:52 2021] DELETE /identity/v3/users/8a85216c17234c099440b2e2c7934755 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:15:53.135269 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f56fea-4b31-4a52-900d-360b6ee7470c service swift] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:53.144964 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f56fea-4b31-4a52-900d-360b6ee7470c service swift] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:53.201807 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:53.202597 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:53.202884 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:53.203162 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] PATH_INFO: `/v3/projects/6ce504669b154dd7b2cb45a21d8b889b` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:53.204318 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce504669b154dd7b2cb45a21d8b889b)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:53.206211 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:53.250589 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce504669b154dd7b2cb45a21d8b889b', 'request_id': 'req-48410404-5e3f-4758-a125-2c05c4fa3fa7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.257108 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce504669b154dd7b2cb45a21d8b889b', 'request_id': 'req-48410404-5e3f-4758-a125-2c05c4fa3fa7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.264237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce504669b154dd7b2cb45a21d8b889b', 'request_id': 'req-48410404-5e3f-4758-a125-2c05c4fa3fa7'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.274593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] The token cache is being invalidate because project 6ce504669b154dd7b2cb45a21d8b889b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:15:53.274873 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.275480 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.276994 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1431/2846] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:15:53 2021] DELETE /identity/v3/projects/6ce504669b154dd7b2cb45a21d8b889b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:15:53.280967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:53.282309 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:53.296121 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab38a-86d0-4320-aed3-bb5bcb92bb81 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:53.353729 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:53.354624 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:53.354913 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:53.355189 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] PATH_INFO: `/v3/users/877b897e6d4940d39aa353eb4daf1704` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:53.356356 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=877b897e6d4940d39aa353eb4daf1704)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:53.358282 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:53.405537 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877b897e6d4940d39aa353eb4daf1704'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.417806 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877b897e6d4940d39aa353eb4daf1704'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.418471 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877b897e6d4940d39aa353eb4daf1704'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.425708 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877b897e6d4940d39aa353eb4daf1704'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.426311 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877b897e6d4940d39aa353eb4daf1704'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.438543 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1416/2847] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:15:53 2021] DELETE /identity/v3/users/877b897e6d4940d39aa353eb4daf1704 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:15:53.602539 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:53.603932 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:53.623600 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410404-5e3f-4758-a125-2c05c4fa3fa7 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:53.680178 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:53.681055 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:53.681337 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:53.681613 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] PATH_INFO: `/v3/projects/eac5e9bf63b64f5981e650ee0a1a9512` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:53.682753 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac5e9bf63b64f5981e650ee0a1a9512)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:53.684714 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:53.729958 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac5e9bf63b64f5981e650ee0a1a9512', 'request_id': 'req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.736086 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac5e9bf63b64f5981e650ee0a1a9512', 'request_id': 'req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.743025 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac5e9bf63b64f5981e650ee0a1a9512', 'request_id': 'req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.752638 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] The token cache is being invalidate because project eac5e9bf63b64f5981e650ee0a1a9512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:15:53.752962 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.753570 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-7ac0a215-e7ff-461d-8b57-1dc74e6f2ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:53.755060 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1432/2848] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:15:53 2021] DELETE /identity/v3/projects/eac5e9bf63b64f5981e650ee0a1a9512 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:17:00.879263 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:17:00.880749 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:17:00.947036 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9487-21ae-45d7-909c-e8a4f4cc44fd admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:17:01.002016 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:17:01.002663 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:17:01.002953 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:17:01.003231 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:17:01.005021 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:17:01.018875 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:17:01.020491 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:17:01.029640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1417/2849] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:17:00 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:17:19.590885 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e4153-6c19-44a8-bfed-8003b6a2f906 None None] REQUEST_METHOD: `POST` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:17:19.591381 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e4153-6c19-44a8-bfed-8003b6a2f906 None None] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:17:19.591481 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e4153-6c19-44a8-bfed-8003b6a2f906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:17:19.611565 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.auth.core [None req-573e4153-6c19-44a8-bfed-8003b6a2f906 None None] MFA Rules not processed for user `21290886e90f45f582840b785d64cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=72578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:17:19.612771 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-573e4153-6c19-44a8-bfed-8003b6a2f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:17:19.663249 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1433/2850] 10.222.0.16 () {58 vars in 958 bytes} [Wed Jul 28 04:17:19 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:17:26.071313 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:17:26.072671 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:17:26.142568 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbe43d-2868-4ed4-bbf8-9cb9e420352b service placement] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:17:26.148743 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:17:26.149396 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:17:26.149680 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:17:26.149958 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:17:26.152327 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:17:26.162346 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:17:26.164409 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:17:26.174193 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1418/2851] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:17:26 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:18:04.624525 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e4153-6c19-44a8-bfed-8003b6a2f906 None None] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:18:04.626089 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-573e4153-6c19-44a8-bfed-8003b6a2f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:18:04.679335 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e4153-6c19-44a8-bfed-8003b6a2f906 None None] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:18:04.683352 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:18:04.684046 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:18:04.684322 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:18:04.684593 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:18:04.686282 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:18:04.694937 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:18:04.696413 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:18:04.704402 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1434/2852] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:18:04 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:19:04.479233 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:19:04.490056 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02764452-fefd-4650-87b7-ea6389d0b837 service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:19:04.495483 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe34d9bb0994e7f80044be0a373ed5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:19:04.496162 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:19:04.496446 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:19:04.496740 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:19:04.498464 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:19:04.510228 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:19:04.512012 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:19:04.521755 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1419/2853] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:19:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:19:04.616796 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:19:04.634889 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc549-e26d-4bd8-93de-4e52afe71761 service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:19:04.638584 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:19:04.639237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:19:04.639521 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:19:04.639828 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:19:04.641719 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:19:04.656015 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:19:04.657467 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:19:04.668454 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1435/2854] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:19:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:19:16.720435 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:19:16.729562 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410979-e9fa-4cee-abf1-1505e78220d4 service nova] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:19:16.733028 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78279cb4fa504d18943cd8807b674cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:19:16.733662 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] REQUEST_METHOD: `GET` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:19:16.733945 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:19:16.734222 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:19:16.736207 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:19:16.816187 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:19:16.817555 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:19:16.835782 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1420/2855] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:19:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:19:22.838865 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:19:22.840422 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:19:22.856991 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73233e5-980e-4e84-bbf6-9070c11ef37c service neutron] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:19:22.861625 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:19:22.862443 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:19:22.862724 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:19:22.863002 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] PATH_INFO: `/v3/users/21290886e90f45f582840b785d64cd43` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:19:22.864176 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=21290886e90f45f582840b785d64cd43)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:19:22.866128 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:19:22.920658 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21290886e90f45f582840b785d64cd43'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:22.937879 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21290886e90f45f582840b785d64cd43'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:22.944510 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21290886e90f45f582840b785d64cd43'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:22.945242 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21290886e90f45f582840b785d64cd43'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:22.954775 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21290886e90f45f582840b785d64cd43'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:22.961152 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1436/2856] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:19:22 2021] DELETE /identity/v3/users/21290886e90f45f582840b785d64cd43 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:19:23.140919 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:19:23.155110 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be3054-08d7-45d2-8f4c-a38561cd9075 service neutron] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:19:23.212738 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:19:23.213582 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:19:23.213860 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:19:23.214128 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] PATH_INFO: `/v3/projects/699932c5162645f89bbd9d95710d863b` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:19:23.215254 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699932c5162645f89bbd9d95710d863b)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:19:23.217174 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:19:23.260935 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699932c5162645f89bbd9d95710d863b', 'request_id': 'req-7303b328-148d-4b7d-8d5b-c633497402d3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.266756 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699932c5162645f89bbd9d95710d863b', 'request_id': 'req-7303b328-148d-4b7d-8d5b-c633497402d3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.273733 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699932c5162645f89bbd9d95710d863b', 'request_id': 'req-7303b328-148d-4b7d-8d5b-c633497402d3'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.283551 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] The token cache is being invalidate because project 699932c5162645f89bbd9d95710d863b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:19:23.283856 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.284461 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.285952 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1421/2857] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:19:23 2021] DELETE /identity/v3/projects/699932c5162645f89bbd9d95710d863b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:19:23.290067 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:19:23.292001 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:19:23.303652 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605453-ca0d-47ef-b55d-b7a33f1f1aea admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:19:23.358185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:19:23.359056 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:19:23.359339 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:19:23.359618 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] PATH_INFO: `/v3/users/2b6b9711ab5345638cf5a6977b55bb37` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:19:23.361049 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6b9711ab5345638cf5a6977b55bb37)` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:19:23.363010 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:19:23.408836 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6b9711ab5345638cf5a6977b55bb37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.420351 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6b9711ab5345638cf5a6977b55bb37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.426906 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6b9711ab5345638cf5a6977b55bb37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.427580 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6b9711ab5345638cf5a6977b55bb37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.435071 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.notifications [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6b9711ab5345638cf5a6977b55bb37'} {{(pid=72578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.440840 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1437/2858] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Jul 28 04:19:23 2021] DELETE /identity/v3/users/2b6b9711ab5345638cf5a6977b55bb37 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:19:23.608278 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] Authenticating user token {{(pid=72579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:19:23.609991 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.fernet_utils [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:19:23.622899 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303b328-148d-4b7d-8d5b-c633497402d3 admin admin] Validating token access rules against request {{(pid=72579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:19:23.680967 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398ba2372d694a5b8498f1f6df8ec46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74500eac66c48568f2eb64dd512dfc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:19:23.681800 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:19:23.682080 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:19:23.682353 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] PATH_INFO: `/v3/projects/d2c2d70ab9114a06818ee7f77b1040d6` {{(pid=72579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:19:23.683503 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c2d70ab9114a06818ee7f77b1040d6)` {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:19:23.685459 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] RBAC: Authorization granted {{(pid=72579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:19:23.729514 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c2d70ab9114a06818ee7f77b1040d6', 'request_id': 'req-5facc075-c33c-476b-b16b-90a79d70f0ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.735604 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c2d70ab9114a06818ee7f77b1040d6', 'request_id': 'req-5facc075-c33c-476b-b16b-90a79d70f0ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.742481 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c2d70ab9114a06818ee7f77b1040d6', 'request_id': 'req-5facc075-c33c-476b-b16b-90a79d70f0ce'} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.752640 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] The token cache is being invalidate because project d2c2d70ab9114a06818ee7f77b1040d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:19:23.752926 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.753549 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: DEBUG keystone.notifications [None req-5facc075-c33c-476b-b16b-90a79d70f0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:19:23.755054 dv-cinder-733062-21-iscsi devstack@keystone.service[72579]: [pid: 72579|app: 0|req: 1422/2859] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Jul 28 04:19:23 2021] DELETE /identity/v3/projects/d2c2d70ab9114a06818ee7f77b1040d6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:22:07.939185 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] Authenticating user token {{(pid=72578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:22:07.940594 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:22:08.072801 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc86a1-ba87-45d4-91ea-70a13a022837 admin admin] Validating token access rules against request {{(pid=72578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:22:08.128312 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870dc27-92c6-4475-9a58-c3f126485f3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b5335392b4400d94f1dfce0e010b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cbdc0d5c968408dbf1eaaafced2d209', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:22:08.128965 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870dc27-92c6-4475-9a58-c3f126485f3b service placement] REQUEST_METHOD: `GET` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:22:08.129245 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870dc27-92c6-4475-9a58-c3f126485f3b service placement] SCRIPT_NAME: `/identity` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:22:08.129517 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870dc27-92c6-4475-9a58-c3f126485f3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:22:08.131237 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.fernet_utils [None req-a870dc27-92c6-4475-9a58-c3f126485f3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:22:08.141636 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870dc27-92c6-4475-9a58-c3f126485f3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:22:08.143202 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870dc27-92c6-4475-9a58-c3f126485f3b service placement] RBAC: Authorization granted {{(pid=72578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:22:08.152007 dv-cinder-733062-21-iscsi devstack@keystone.service[72578]: [pid: 72578|app: 0|req: 1438/2860] 10.222.0.16 () {60 vars in 1366 bytes} [Wed Jul 28 04:22:07 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)